From owner-freebsd-embedded@freebsd.org Thu Jun 20 22:27:58 2019 Return-Path: Delivered-To: freebsd-embedded@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6BA7615C94C2 for ; Thu, 20 Jun 2019 22:27:58 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-qt1-x830.google.com (mail-qt1-x830.google.com [IPv6:2607:f8b0:4864:20::830]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 0F04C6A587 for ; Thu, 20 Jun 2019 22:27:56 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: by mail-qt1-x830.google.com with SMTP id i34so4907117qta.6 for ; Thu, 20 Jun 2019 15:27:56 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=i++vuPkSLspSdeZZAn/h6aCShWANC5V4o7Tnswm2rFA=; b=N+5Aw/VKtpxOYCUNzjGstFksGRsmgkQbtwBmBvX9XNBmWLZykkj6aL9ntwgLkWkIs+ SFA0zrYM/K5Nyo4ants1DoAFc5tFTf5QepeBlKDhPsdhGqx1f00whwilnV3LiekchndB f9+4qgTktl5BaEKPCSCVqx706/Yz93yrsd6XIkexaGIm24xSLECEMYsTA7np2vRViwRl AKarUdwx/14nCyzG6onqZQr+j/ZDggoUOuFWXmznq2Z+bOk4nXquvNWBOK/WDXcbdZ1K 4bMSAhpMKh5Ic42f73YvssQ1HuttfDzyZErc2EJBex4hfyefHHijQ817baymAhyFCaqu ygvw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=i++vuPkSLspSdeZZAn/h6aCShWANC5V4o7Tnswm2rFA=; b=dyPrN1/t1pYMzSEfUziHaOYtmgxvvf9NYeFRnFppsYiz7Q0CXQi2526KRLLOeyZSuR Tiyiws3EgNmP+LO4j4xr7L3gKVxZDk7yqbfwkPWYybFI83kkB3YV7yS3HMAofPW60lo/ zE4YyGNcaL/lKgLK+H50WOJG4uGUQkE/CH+3dEIYXfNubCTBeRlnYnoxGL9Tx2jzCd0P DgnV20nq6VLCRmOtlic+xMmIyRI6rhNKfLc5EsnHa5emK99MAFCBbSXlQyOHLh+9MLwW YcEgrlNJXuelFhzlrfL1w0RJDnDQingBSqkpHtTP/sC50x1J92ovlC/BU2lsf/drG71L dYtQ== X-Gm-Message-State: APjAAAUYaexX/Ckt4B4DKWXDkld/TQ69YjsmqRTwCIF+5j+sof86EYvG tfBjT9B/hQ5JHtVg0/9Kv7DzYyH4l8rkRvi+DvRWpZeep5sVRg== X-Google-Smtp-Source: APXvYqzdtD7hyiog9JDBjMAP3wd99HPSz73vmVxlitLhLLaWm/3BjCnbABgc2qPmY9IsS5+uX5HWRZ2eUlgoFtcQAbA= X-Received: by 2002:a0c:acfb:: with SMTP id n56mr733043qvc.87.1561069676194; Thu, 20 Jun 2019 15:27:56 -0700 (PDT) MIME-Version: 1.0 References: <27515540-54ef-6e7e-1b87-9be875b54c22@denninger.net> In-Reply-To: From: Warner Losh Date: Thu, 20 Jun 2019 15:27:45 -0700 Message-ID: Subject: Re: NanoBSD cust_pkgng problem.... To: Karl Denninger Cc: freebsd-embedded X-Rspamd-Queue-Id: 0F04C6A587 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=bsdimp-com.20150623.gappssmtp.com header.s=20150623 header.b=N+5Aw/VK X-Spamd-Result: default: False [-4.97 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.999,0]; R_DKIM_ALLOW(-0.20)[bsdimp-com.20150623.gappssmtp.com:s=20150623]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_SHORT(-0.98)[-0.981,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-embedded@freebsd.org]; DMARC_NA(0.00)[bsdimp.com]; URI_COUNT_ODD(1.00)[1]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; MX_GOOD(-0.01)[cached: ALT1.aspmx.l.google.com]; DKIM_TRACE(0.00)[bsdimp-com.20150623.gappssmtp.com:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[0.3.8.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; R_SPF_NA(0.00)[]; FORGED_SENDER(0.30)[imp@bsdimp.com,wlosh@bsdimp.com]; MIME_TRACE(0.00)[0:+,1:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[imp@bsdimp.com,wlosh@bsdimp.com]; IP_SCORE(-2.98)[ip: (-9.38), ipnet: 2607:f8b0::/32(-3.15), asn: 15169(-2.32), country: US(-0.06)]; RCVD_COUNT_TWO(0.00)[2] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-embedded@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Dedicated and Embedded Systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Jun 2019 22:27:58 -0000 On Thu, Jun 20, 2019 at 1:28 PM Karl Denninger wrote: > > On 6/20/2019 14:46, Warner Losh wrote: > > > > > > On Thu, Jun 20, 2019, 12:40 PM Ian Lepore > > wrote: > > > > On Thu, 2019-06-20 at 13:16 -0500, Karl Denninger wrote: > > > I'm trying to rebuild 12-STABLE with current code with the > following > > > for > > > the PCEngines systems. > > > > > > NANO_NAME=pcengines > > > NANO_SRC=/usr/src > > > NANO_KERNEL=KSD-SMP > > > NANO_IMAGES=2 > > > NANO_MODULES="default" > > > > > > #NANO_DRIVE=ad0 > > > NANO_DRIVE=mmcsd0 > > > > > > NANO_RAM_ETCSIZE=30720 > > > #NANO_RAM_TMPVARSIZE=30720 > > > NANO_RAM_TMPVARSIZE=131072 > > > > > > NANO_PACKAGE_DIR=/work/PKG-AMD64-12/pkg > > > > > > # Configuration slice size set to 64Mb > > > # > > > NANO_CONFSIZE=$((64*1000*1000/512)) > > > # > > > # Set "data" partition to 512MB > > > # > > > NANO_DATASIZE=$((512*1000*1000/512)) > > > > > > NANO_OBJ="/work/Crochet-work-AMD/obj" > > > > > > NANO_PMAKE="make -j 8" > > > > > > # 7.5Gb SD image; will fit on a 8Gb card, but is REAL tight! > > > #NANO_MEDIASIZE=$((7*1000*1000*1000/512 + 1000*1000*512/512)) > > > # > > > # 12Gb SD image; fits on 16Gb SD card and has more room for > packages > > > NANO_MEDIASIZE=$((12*1000*1000*1000/512)) > > > > > > The packages are in /work/PKG-AMD64-12 as expected. I have a > little > > > script that gets them which is: > > > > > > PKGDIR='/work/PKG-AMD64-12' > > > export PKGDIR > > > PKG_CACHEDIR=/work/PKG-AMD64-12/cache > > > export PKG_CACHEDIR > > > > > > ABI=FreeBSD:12:amd64 > > > export ABI > > > > > > pkg -R . -r . -o $PKGDIR/pkgs fetch -d \ > > > bind914 rsync sshguard strongswan dhcp6 \ > > > net-snmp ntimed openvpn flashrom dmidecode > > > # net-snmp ntimed openvpn flashrom dmidecode ssmtp > > > # bind914 rsync sshguard strongswan dhcp6 isc-dhcp44-server \ > > > > > > rm -rf $PKGDIR/pkg > > > mkdir -p $PKGDIR/pkg > > > > > > cd $PKG_CACHEDIR > > > find . -type l -print -exec cp {} ../pkg \; > > > > > > /work/PKG-AMD64-12 has a repo.conf file and such; I use the same > > > mechanism to fetch for Crochet for the ARM64 platforms. > > > > > > Note the two commented lines. If I include EITHER ssmpt or > > > isc-dhcp44-server cust_pkgng fails, but the error simply says the > > > install failed without a reason for it. > > > > > > If I do NOT include those two the build succeeds. Neither of them, > > > if I > > > add them back in, discloses a missing dependency or similar. > > > > > > pkg: Cannot open /dev/null:No such file or directory > > > Extracting flashrom-1.0_1: ........ done > > > Message from python27-2.7.16_1: > > > > > > > > ===================================================================== > > > ====== > > > > > > Note that some standard Python modules are provided as separate > > ports > > > as they require additional dependencies. They are available as: > > > > > > bsddb databases/py-bsddb > > > gdbm databases/py-gdbm > > > sqlite3 databases/py-sqlite3 > > > tkinter x11-toolkits/py-tkinter > > > > > > > > ===================================================================== > > > ====== > > > + CR 'env BATCH=YES ASSUME_ALWAYS_YES=YES PKG_DBDIR=/var/db/pkg > > > SIGNATURE_TYPE=none /usr/sbin/pkg add /_.p/gettext-runtime- > > > 0.20.1.txz' > > > + chroot /work/Crochet-work-AMD/obj/_.w /bin/sh -exc 'env BATCH=YES > > > ASSUME_ALWAYS_YES=YES PKG_DBDIR=/var/db/pkg SIGNATURE_TYPE=none > > > /usr/sbin/pkg add /_.p/gettext-runtime-0.20.1.txz' > > > + env 'BATCH=YES' 'ASSUME_ALWAYS_YES=YES' 'PKG_DBDIR=/var/db/pkg' > > > 'SIGNATURE_TYPE=none' /usr/sbin/pkg add /_.p/gettext-runtime- > > > 0.20.1.txz > > > Installing gettext-runtime-0.20.1... > > > the most recent version of gettext-runtime-0.20.1 is already > > > installed > > > + CR 'env BATCH=YES ASSUME_ALWAYS_YES=YES PKG_DBDIR=/var/db/pkg > > > SIGNATURE_TYPE=none /usr/sbin/pkg add /_.p/icu-64.2,1.txz' > > > + chroot /work/Crochet-work-AMD/obj/_.w /bin/sh -exc 'env BATCH=YES > > > ASSUME_ALWAYS_YES=YES PKG_DBDIR=/var/db/pkg SIGNATURE_TYPE=none > > > /usr/sbin/pkg add /_.p/icu-64.2,1.txz' > > > + env 'BATCH=YES' 'ASSUME_ALWAYS_YES=YES' 'PKG_DBDIR=/var/db/pkg' > > > 'SIGNATURE_TYPE=none' /usr/sbin/pkg add /_.p/icu-64.2,1.txz > > > Installing icu-64.2,1... > > > the most recent version of icu-64.2,1 is already installed > > > + CR 'env BATCH=YES ASSUME_ALWAYS_YES=YES PKG_DBDIR=/var/db/pkg > > > SIGNATURE_TYPE=none /usr/sbin/pkg add /_.p/indexinfo-0.3.1.txz' > > > + chroot /work/Crochet-work-AMD/obj/_.w /bin/sh -exc 'env BATCH=YES > > > ASSUME_ALWAYS_YES=YES PKG_DBDIR=/var/db/pkg SIGNATURE_TYPE=none > > > /usr/sbin/pkg add /_.p/indexinfo-0.3.1.txz' > > > + env 'BATCH=YES' 'ASSUME_ALWAYS_YES=YES' 'PKG_DBDIR=/var/db/pkg' > > > 'SIGNATURE_TYPE=none' /usr/sbin/pkg add /_.p/indexinfo-0.3.1.txz > > > Installing indexinfo-0.3.1... > > > the most recent version of indexinfo-0.3.1 is already installed > > > + CR 'env BATCH=YES ASSUME_ALWAYS_YES=YES PKG_DBDIR=/var/db/pkg > > > SIGNATURE_TYPE=none /usr/sbin/pkg add /_.p/isc-dhcp44-server- > > > 4.4.1_4.txz' > > > + chroot /work/Crochet-work-AMD/obj/_.w /bin/sh -exc 'env BATCH=YES > > > ASSUME_ALWAYS_YES=YES PKG_DBDIR=/var/db/pkg SIGNATURE_TYPE=none > > > /usr/sbin/pkg add /_.p/isc-dhcp44-server-4.4.1_4.txz' > > > + env 'BATCH=YES' 'ASSUME_ALWAYS_YES=YES' 'PKG_DBDIR=/var/db/pkg' > > > 'SIGNATURE_TYPE=none' /usr/sbin/pkg add /_.p/isc-dhcp44-server- > > > 4.4.1_4.txz > > > Installing isc-dhcp44-server-4.4.1_4... > > > pkg: Cannot open /dev/null:No such file or directory > > > > > > Failed to install the following 1 package(s): > > > /_.p/isc-dhcp44-server-4.4.1_4.txz > > > + umount /work/Crochet-work-AMD/obj/_.w/_.p > > > + rm -rf /work/Crochet-work-AMD/obj/_.w/_.p > > > + echo 'NANO RM -rf /work/Crochet-work-AMD/obj/_.w/_.p' > > > NANO RM -rf /work/Crochet-work-AMD/obj/_.w/_.p > > > + uname -r > > > + command rm -x -rf /work/Crochet-work-AMD/obj/_.w/_.p > > > > > > Note that's not the "can't open /dev/null" complaint since that > > > appears > > > up above (and in fact a bunch of other times previously as well) > and > > > doesn't blow the install up. But *something* is causing the > install > > > for > > > those two packages -- and only these two, as the other ~40 odd with > > > dependencies are fine -- to exit non-zero and blow up the build. > > > > > > It's tough to run this down without an error message that tells me > > > exactly what it's upset about. > > > > > > Any ideas? > > > > > > > I think it's a mistake to ignore the /dev/null errors. It's quite > > possible that the error is non-fatal when installing some packages > and > > fatal when installing others. The message indicates you need to > mount > > devfs within the chroot or jail being used to run pkg. > > > > > > I agree, but for different reasons. Pkg is now using it, which is why > > we see a new error. None of the packages installed threw error > > messages before, so I think his setup is ok. > > > > Warner > > > I can confirm that with defaults.sh patched it now runs to completion on > the "latest" without problems. > I'll get it committed a bit later today. Can someone test the following: diff --git a/tools/tools/nanobsd/defaults.sh b/tools/tools/nanobsd/defaults.sh index 0002373be658..86acab65f67d 100755 --- a/tools/tools/nanobsd/defaults.sh +++ b/tools/tools/nanobsd/defaults.sh @@ -778,8 +778,9 @@ cust_pkgng ( ) ( # Mount packages into chroot mkdir -p ${NANO_WORLDDIR}/_.p mount -t nullfs -o noatime -o ro ${NANO_PACKAGE_DIR} ${NANO_WORLDDIR}/_.p + mount -t devfs devfs ${NANO_WORLDDIR}/dev - trap "umount ${NANO_WORLDDIR}/_.p ; rm -rf ${NANO_WORLDDIR}/_.p" 1 2 15 EXIT + trap "umount ${NANO_WORLDDIR}/dev; umount ${NANO_WORLDDIR}/_.p ; rm -rf ${NANO_WORLDDIR}/_.p" 1 2 15 EXIT # Install pkg-* package CR "${PKGCMD} add /_.p/${_NANO_PKG_PACKAGE}" @@ -804,6 +805,7 @@ cust_pkgng ( ) ( CR0 "${PKGCMD} info" trap - 1 2 15 EXIT + umount ${NANO_WORLDDIR}/dev umount ${NANO_WORLDDIR}/_.p rm -rf ${NANO_WORLDDIR}/_.p ) since we need to umount it if we hit the trap exit. Warner