From owner-freebsd-embedded@freebsd.org Fri Jun 21 04:02:06 2019 Return-Path: Delivered-To: freebsd-embedded@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1866E15CF78C for ; Fri, 21 Jun 2019 04:02:06 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-qt1-x843.google.com (mail-qt1-x843.google.com [IPv6:2607:f8b0:4864:20::843]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B1DEC7481F for ; Fri, 21 Jun 2019 04:02:04 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: by mail-qt1-x843.google.com with SMTP id x2so5626317qtr.0 for ; Thu, 20 Jun 2019 21:02:04 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=eYmDC5mGEEYm5D00zrxv1jcC5+RYwY6d28nPNhrJZX4=; b=El0c4ZlzMhJrkO6f1qSJfs2xe9yhYn+PvzRpGMLgEmyB/+EdcoBi2+TnhJT5hSiHKb Y25lju2myAuJIu15XWILehZn3A3xK9tMk6tsrBP2++7PUS3wAzMDhpTOLwAMvQDRI+JW /EXRSPnmvLj7ORwESEjQPrQtx7SASVtuB7RTnvjcOkEmhizdfzenNdIfb2DLIBjDI8cL Z5w46Vf+eC3CmqcG2UGO+vzCmEnqcgXBb6bze9kV+gl26fiLBWzMNJtjDMCKc2PCKHhA Gc4jqaS1W6VQ/2uGqsrp0gsGVaCKgGgJMOXuKyFgN85d55RgK/ZGN6/gzP3VBiSMKzXS Qppg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=eYmDC5mGEEYm5D00zrxv1jcC5+RYwY6d28nPNhrJZX4=; b=MEBAOyFyq0hj4fDZd7wrGH5BxUPTgjWLxtl2DSf/DymKeUq2mAxavcjPsc4S25tYGM HzDhXU4HY4JJpWCowHIXgaQMNpJMz/TC8ILMy0DXoZRWdG5kutXDGdXmg9C0fdjO8YGt J32Xodi/LtCYGapDNea54spS+FBWSWMUHQxs5FupBxOB45vvH/c3890RzvNHc4gTVQP6 91pKaBBus5EWmH7crKp44Vx5vxOT2DQQFdGJ2H5Fgh2vE04kwAXpetxhv4pBTrEKfaJH L0aKLqBFC/sIFz5Z9ddy1JRDncmzVBUR9ULHfvySYUkMmRv22rsq9rnafeLclTDWVW6L rhlQ== X-Gm-Message-State: APjAAAXaiEz2Tm6hKK5rPEtJCO6dxjuScola3jw+VumU5kDbVVqTRmvY LaE7n2MZwmvSJll8UaRcWJrnLINblZWL8n/NIcRtpg== X-Google-Smtp-Source: APXvYqzynjpJNhn5Cl5cD5CYKx/GzdQQOB7FTRuvTrBhNgW7CU3C9YJiChQu9V7X7sSM/1e8iz3SwBTN24O/CJISx/4= X-Received: by 2002:a0c:b66f:: with SMTP id q47mr42634008qvf.102.1561089723651; Thu, 20 Jun 2019 21:02:03 -0700 (PDT) MIME-Version: 1.0 References: <27515540-54ef-6e7e-1b87-9be875b54c22@denninger.net> <645f2271-276d-6dd6-74b2-20a0843363f4@denninger.net> In-Reply-To: <645f2271-276d-6dd6-74b2-20a0843363f4@denninger.net> From: Warner Losh Date: Thu, 20 Jun 2019 21:01:51 -0700 Message-ID: Subject: Re: NanoBSD cust_pkgng problem.... To: Karl Denninger Cc: freebsd-embedded X-Rspamd-Queue-Id: B1DEC7481F X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=bsdimp-com.20150623.gappssmtp.com header.s=20150623 header.b=El0c4Zlz X-Spamd-Result: default: False [-2.64 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.99)[-0.989,0]; R_DKIM_ALLOW(-0.20)[bsdimp-com.20150623.gappssmtp.com:s=20150623]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_SHORT(-0.91)[-0.909,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-embedded@freebsd.org]; DMARC_NA(0.00)[bsdimp.com]; URI_COUNT_ODD(1.00)[1]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; MX_GOOD(-0.01)[cached: ALT1.aspmx.l.google.com]; DKIM_TRACE(0.00)[bsdimp-com.20150623.gappssmtp.com:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[3.4.8.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; R_SPF_NA(0.00)[]; FORGED_SENDER(0.30)[imp@bsdimp.com,wlosh@bsdimp.com]; MIME_TRACE(0.00)[0:+,1:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[imp@bsdimp.com,wlosh@bsdimp.com]; IP_SCORE(-0.73)[ip: (1.86), ipnet: 2607:f8b0::/32(-3.15), asn: 15169(-2.32), country: US(-0.06)]; RCVD_COUNT_TWO(0.00)[2] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-embedded@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Dedicated and Embedded Systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 21 Jun 2019 04:02:06 -0000 Committed as r349261 Warner On Thu, Jun 20, 2019 at 7:19 PM Karl Denninger wrote: > Hand-applied the patch (with vi, not patch, since I already had some of > the changes in there) and it ran to completion without incident. > On 6/20/2019 17:27, Warner Losh wrote: > > > > On Thu, Jun 20, 2019 at 1:28 PM Karl Denninger wrote: > >> >> On 6/20/2019 14:46, Warner Losh wrote: >> > >> > >> > On Thu, Jun 20, 2019, 12:40 PM Ian Lepore > > > wrote: >> > >> > On Thu, 2019-06-20 at 13:16 -0500, Karl Denninger wrote: >> > > I'm trying to rebuild 12-STABLE with current code with the >> following >> > > for >> > > the PCEngines systems. >> > > >> > > NANO_NAME=pcengines >> > > NANO_SRC=/usr/src >> > > NANO_KERNEL=KSD-SMP >> > > NANO_IMAGES=2 >> > > NANO_MODULES="default" >> > > >> > > #NANO_DRIVE=ad0 >> > > NANO_DRIVE=mmcsd0 >> > > >> > > NANO_RAM_ETCSIZE=30720 >> > > #NANO_RAM_TMPVARSIZE=30720 >> > > NANO_RAM_TMPVARSIZE=131072 >> > > >> > > NANO_PACKAGE_DIR=/work/PKG-AMD64-12/pkg >> > > >> > > # Configuration slice size set to 64Mb >> > > # >> > > NANO_CONFSIZE=$((64*1000*1000/512)) >> > > # >> > > # Set "data" partition to 512MB >> > > # >> > > NANO_DATASIZE=$((512*1000*1000/512)) >> > > >> > > NANO_OBJ="/work/Crochet-work-AMD/obj" >> > > >> > > NANO_PMAKE="make -j 8" >> > > >> > > # 7.5Gb SD image; will fit on a 8Gb card, but is REAL tight! >> > > #NANO_MEDIASIZE=$((7*1000*1000*1000/512 + 1000*1000*512/512)) >> > > # >> > > # 12Gb SD image; fits on 16Gb SD card and has more room for >> packages >> > > NANO_MEDIASIZE=$((12*1000*1000*1000/512)) >> > > >> > > The packages are in /work/PKG-AMD64-12 as expected. I have a >> little >> > > script that gets them which is: >> > > >> > > PKGDIR='/work/PKG-AMD64-12' >> > > export PKGDIR >> > > PKG_CACHEDIR=/work/PKG-AMD64-12/cache >> > > export PKG_CACHEDIR >> > > >> > > ABI=FreeBSD:12:amd64 >> > > export ABI >> > > >> > > pkg -R . -r . -o $PKGDIR/pkgs fetch -d \ >> > > bind914 rsync sshguard strongswan dhcp6 \ >> > > net-snmp ntimed openvpn flashrom dmidecode >> > > # net-snmp ntimed openvpn flashrom dmidecode ssmtp >> > > # bind914 rsync sshguard strongswan dhcp6 isc-dhcp44-server >> \ >> > > >> > > rm -rf $PKGDIR/pkg >> > > mkdir -p $PKGDIR/pkg >> > > >> > > cd $PKG_CACHEDIR >> > > find . -type l -print -exec cp {} ../pkg \; >> > > >> > > /work/PKG-AMD64-12 has a repo.conf file and such; I use the same >> > > mechanism to fetch for Crochet for the ARM64 platforms. >> > > >> > > Note the two commented lines. If I include EITHER ssmpt or >> > > isc-dhcp44-server cust_pkgng fails, but the error simply says the >> > > install failed without a reason for it. >> > > >> > > If I do NOT include those two the build succeeds. Neither of >> them, >> > > if I >> > > add them back in, discloses a missing dependency or similar. >> > > >> > > pkg: Cannot open /dev/null:No such file or directory >> > > Extracting flashrom-1.0_1: ........ done >> > > Message from python27-2.7.16_1: >> > > >> > > >> > >> ===================================================================== >> > > ====== >> > > >> > > Note that some standard Python modules are provided as separate >> > ports >> > > as they require additional dependencies. They are available as: >> > > >> > > bsddb databases/py-bsddb >> > > gdbm databases/py-gdbm >> > > sqlite3 databases/py-sqlite3 >> > > tkinter x11-toolkits/py-tkinter >> > > >> > > >> > >> ===================================================================== >> > > ====== >> > > + CR 'env BATCH=YES ASSUME_ALWAYS_YES=YES PKG_DBDIR=/var/db/pkg >> > > SIGNATURE_TYPE=none /usr/sbin/pkg add /_.p/gettext-runtime- >> > > 0.20.1.txz' >> > > + chroot /work/Crochet-work-AMD/obj/_.w /bin/sh -exc 'env >> BATCH=YES >> > > ASSUME_ALWAYS_YES=YES PKG_DBDIR=/var/db/pkg SIGNATURE_TYPE=none >> > > /usr/sbin/pkg add /_.p/gettext-runtime-0.20.1.txz' >> > > + env 'BATCH=YES' 'ASSUME_ALWAYS_YES=YES' 'PKG_DBDIR=/var/db/pkg' >> > > 'SIGNATURE_TYPE=none' /usr/sbin/pkg add /_.p/gettext-runtime- >> > > 0.20.1.txz >> > > Installing gettext-runtime-0.20.1... >> > > the most recent version of gettext-runtime-0.20.1 is already >> > > installed >> > > + CR 'env BATCH=YES ASSUME_ALWAYS_YES=YES PKG_DBDIR=/var/db/pkg >> > > SIGNATURE_TYPE=none /usr/sbin/pkg add /_.p/icu-64.2,1.txz' >> > > + chroot /work/Crochet-work-AMD/obj/_.w /bin/sh -exc 'env >> BATCH=YES >> > > ASSUME_ALWAYS_YES=YES PKG_DBDIR=/var/db/pkg SIGNATURE_TYPE=none >> > > /usr/sbin/pkg add /_.p/icu-64.2,1.txz' >> > > + env 'BATCH=YES' 'ASSUME_ALWAYS_YES=YES' 'PKG_DBDIR=/var/db/pkg' >> > > 'SIGNATURE_TYPE=none' /usr/sbin/pkg add /_.p/icu-64.2,1.txz >> > > Installing icu-64.2,1... >> > > the most recent version of icu-64.2,1 is already installed >> > > + CR 'env BATCH=YES ASSUME_ALWAYS_YES=YES PKG_DBDIR=/var/db/pkg >> > > SIGNATURE_TYPE=none /usr/sbin/pkg add /_.p/indexinfo-0.3.1.txz' >> > > + chroot /work/Crochet-work-AMD/obj/_.w /bin/sh -exc 'env >> BATCH=YES >> > > ASSUME_ALWAYS_YES=YES PKG_DBDIR=/var/db/pkg SIGNATURE_TYPE=none >> > > /usr/sbin/pkg add /_.p/indexinfo-0.3.1.txz' >> > > + env 'BATCH=YES' 'ASSUME_ALWAYS_YES=YES' 'PKG_DBDIR=/var/db/pkg' >> > > 'SIGNATURE_TYPE=none' /usr/sbin/pkg add /_.p/indexinfo-0.3.1.txz >> > > Installing indexinfo-0.3.1... >> > > the most recent version of indexinfo-0.3.1 is already installed >> > > + CR 'env BATCH=YES ASSUME_ALWAYS_YES=YES PKG_DBDIR=/var/db/pkg >> > > SIGNATURE_TYPE=none /usr/sbin/pkg add /_.p/isc-dhcp44-server- >> > > 4.4.1_4.txz' >> > > + chroot /work/Crochet-work-AMD/obj/_.w /bin/sh -exc 'env >> BATCH=YES >> > > ASSUME_ALWAYS_YES=YES PKG_DBDIR=/var/db/pkg SIGNATURE_TYPE=none >> > > /usr/sbin/pkg add /_.p/isc-dhcp44-server-4.4.1_4.txz' >> > > + env 'BATCH=YES' 'ASSUME_ALWAYS_YES=YES' 'PKG_DBDIR=/var/db/pkg' >> > > 'SIGNATURE_TYPE=none' /usr/sbin/pkg add /_.p/isc-dhcp44-server- >> > > 4.4.1_4.txz >> > > Installing isc-dhcp44-server-4.4.1_4... >> > > pkg: Cannot open /dev/null:No such file or directory >> > > >> > > Failed to install the following 1 package(s): >> > > /_.p/isc-dhcp44-server-4.4.1_4.txz >> > > + umount /work/Crochet-work-AMD/obj/_.w/_.p >> > > + rm -rf /work/Crochet-work-AMD/obj/_.w/_.p >> > > + echo 'NANO RM -rf /work/Crochet-work-AMD/obj/_.w/_.p' >> > > NANO RM -rf /work/Crochet-work-AMD/obj/_.w/_.p >> > > + uname -r >> > > + command rm -x -rf /work/Crochet-work-AMD/obj/_.w/_.p >> > > >> > > Note that's not the "can't open /dev/null" complaint since that >> > > appears >> > > up above (and in fact a bunch of other times previously as well) >> and >> > > doesn't blow the install up. But *something* is causing the >> install >> > > for >> > > those two packages -- and only these two, as the other ~40 odd >> with >> > > dependencies are fine -- to exit non-zero and blow up the build. >> > > >> > > It's tough to run this down without an error message that tells me >> > > exactly what it's upset about. >> > > >> > > Any ideas? >> > > >> > >> > I think it's a mistake to ignore the /dev/null errors. It's quite >> > possible that the error is non-fatal when installing some packages >> and >> > fatal when installing others. The message indicates you need to >> mount >> > devfs within the chroot or jail being used to run pkg. >> > >> > >> > I agree, but for different reasons. Pkg is now using it, which is why >> > we see a new error. None of the packages installed threw error >> > messages before, so I think his setup is ok. >> > >> > Warner >> > >> I can confirm that with defaults.sh patched it now runs to completion on >> the "latest" without problems. >> > > I'll get it committed a bit later today. Can someone test the following: > > diff --git a/tools/tools/nanobsd/defaults.sh > b/tools/tools/nanobsd/defaults.sh > index 0002373be658..86acab65f67d 100755 > --- a/tools/tools/nanobsd/defaults.sh > +++ b/tools/tools/nanobsd/defaults.sh > @@ -778,8 +778,9 @@ cust_pkgng ( ) ( > # Mount packages into chroot > mkdir -p ${NANO_WORLDDIR}/_.p > mount -t nullfs -o noatime -o ro ${NANO_PACKAGE_DIR} > ${NANO_WORLDDIR}/_.p > + mount -t devfs devfs ${NANO_WORLDDIR}/dev > > - trap "umount ${NANO_WORLDDIR}/_.p ; rm -rf ${NANO_WORLDDIR}/_.p" 1 > 2 15 EXIT > + trap "umount ${NANO_WORLDDIR}/dev; umount ${NANO_WORLDDIR}/_.p ; > rm -rf ${NANO_WORLDDIR}/_.p" 1 2 15 EXIT > > # Install pkg-* package > CR "${PKGCMD} add /_.p/${_NANO_PKG_PACKAGE}" > @@ -804,6 +805,7 @@ cust_pkgng ( ) ( > CR0 "${PKGCMD} info" > > trap - 1 2 15 EXIT > + umount ${NANO_WORLDDIR}/dev > umount ${NANO_WORLDDIR}/_.p > rm -rf ${NANO_WORLDDIR}/_.p > ) > > since we need to umount it if we hit the trap exit. > > Warner > > -- > Karl Denninger > karl@denninger.net > *The Market Ticker* > *[S/MIME encrypted email preferred]* >