Date: Tue, 16 Jul 2024 09:25:20 +0200 (CEST) From: Ronald Klop <ronald-lists@klop.ws> To: Karl Denninger <karl@denninger.net>, "freebsd-pkg@freebsd.org" <freebsd-pkg@freebsd.org> Subject: Re: Probably something stupid -- cannot find SRV records and fails Message-ID: <1053288469.1714.1721114720975@localhost> In-Reply-To: <1436487354.1173.1721112364245@localhost> References: <f5d8d32f-acb7-44f6-a843-99149b493cdf@denninger.net> <1436487354.1173.1721112364245@localhost>
next in thread | previous in thread | raw e-mail | index | archive | help
------=_Part_1713_1753761224.1721114720914 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit Van: Ronald Klop <ronald-lists@klop.ws> Datum: dinsdag, 16 juli 2024 08:46 Aan: Karl Denninger <karl@denninger.net> CC: "freebsd-pkg@freebsd.org" <freebsd-pkg@freebsd.org> Onderwerp: Re: Probably something stupid -- cannot find SRV records and fails > > > Van: Karl Denninger <karl@denninger.net> > Datum: 16 juli 2024 01:01 > Aan: "freebsd-pkg@freebsd.org" <freebsd-pkg@freebsd.org> > Onderwerp: Probably something stupid -- cannot find SRV records and fails >> >> I have a Crochet build environment that runs on a native FreeBSD OS (on metal) without problems and has for quite some time. I'm trying to move that build environment to a VM running on VirtualBox; the host is Windows 11. >> >> Everything appears to work as expected normally, including pulling the source from HEAD, setting up a worktree for stable/14, doing a buildworld/kernel and such and in fact the crossbuild for ARM64 via Crochet -- except the package grab at the end for a set of packages I want on the embedded media output once the install of the system itself into the md is complete. >> >> Again this works fine on my long-standing build box that runs on actual metal, and as far as I can tell there isn't any difference -- I have the same setup (to grab "latest" rather than "quarterly") in /etc/pkg/FreeBSD.conf, for example. >> >> I am getting this, which is a replay (by hand) of what Crochet does at that point -- it does not chroot during the build and runs in the native (in this case AMD64) context, but with the "-c" flag to the mounted install filesystem for the pkg command (which is on an md): >> >> # pwd >> /work/OBJ/ARM64-14-STABLE/_.mount.freebsd >> # env ASSUME_ALWAYS_YES=YES pkg -d -c . install rsync sshbuard ntimed ffmpeg mpg321 git >> DBG(1)[53612]> pkg initialized >> Updating FreeBSD repository catalogue... >> DBG(1)[53612]> PkgRepo: verifying update for FreeBSD >> DBG(1)[53612]> PkgRepo: need forced update of FreeBSD >> DBG(1)[53612]> Pkgrepo, begin update of '/var/db/pkg/repos/FreeBSD/db' >> DBG(1)[53612]> Request to fetch pkg+https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/meta.conf >> DBG(1)[53612]> curl_open >> pkg: No SRV record found for the repo 'FreeBSD' >> DBG(1)[53612]> Fetch: fetcher used: pkg+https >> DBG(1)[53612]> curl> fetching https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/meta.conf >> >> DBG(1)[53612]> CURL> No mirror set url to https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/meta.conf >> >> DBG(1)[53612]> CURL> attempting to fetch from https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/meta.conf, left retry 3 >> >> * Couldn't find host pkg.FreeBSD.org in the .netrc file; using defaults >> * Could not resolve host: pkg.FreeBSD.org >> * Closing connection >> DBG(1)[53612]> CURL> No mirror set url to https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/meta.conf >> >> DBG(1)[53612]> CURL> attempting to fetch from https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/meta.conf, left retry 2 >> >> * Couldn't find host pkg.FreeBSD.org in the .netrc file; using defaults >> * Could not resolve host: pkg.FreeBSD.org >> * Closing connection >> DBG(1)[53612]> CURL> No mirror set url to https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/meta.conf >> >> DBG(1)[53612]> CURL> attempting to fetch from https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/meta.conf, left retry 1 >> >> * Couldn't find host pkg.FreeBSD.org in the .netrc file; using defaults >> * Could not resolve host: pkg.FreeBSD.org >> * Closing connection >> pkg: An error occured while fetching package >> DBG(1)[53612]> Request to fetch pkg+https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/meta.txz >> pkg: packagesite URL error for pkg+https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/meta.txz -- pkg+:// implies SRV mirror type >> repository FreeBSD has no meta file, using default settings >> DBG(1)[53612]> Request to fetch pkg+https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/data.pkg >> pkg: packagesite URL error for pkg+https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/data.pkg -- pkg+:// implies SRV mirror type >> DBG(1)[53612]> Request to fetch pkg+https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/data.txz >> pkg: packagesite URL error for pkg+https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/data.txz -- pkg+:// implies SRV mirror type >> DBG(1)[53612]> Request to fetch pkg+https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/packagesite.pkg >> pkg: packagesite URL error for pkg+https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/packagesite.pkg -- pkg+:// implies SRV mirror type >> DBG(1)[53612]> Request to fetch pkg+https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/packagesite.txz >> pkg: packagesite URL error for pkg+https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/packagesite.txz -- pkg+:// implies SRV mirror type >> Unable to update repository FreeBSD >> Error updating repositories! >> # >> >> What I don't understand here is that it works perfectly fine on a native host, and I don't see anything obvious. I can ping pkg.freebsd.org: >> >> # ping pkg.freebsd.org >> PING pkgmir.geo.freebsd.org (173.228.147.98): 56 data bytes >> 64 bytes from 173.228.147.98: icmp_seq=0 ttl=49 time=58.336 ms >> ^C >> --- pkgmir.geo.freebsd.org ping statistics --- >> 1 packets transmitted, 1 packets received, 0.0% packet loss >> round-trip min/avg/max/stddev = 58.336/58.336/58.336/0.000 ms >> >> Further, a "fetch" against the first requested file (meta.conf) that the pkg command complains about succeeds: >> >> # fetch https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/meta.conf >> meta.conf 178 B 1687 kBps 00s >> >> Any ideas on where to look? I turned debugging on with "-d" because the original build was not giving me any idea of what was happening, but this appears to imply there's no connectivity out of the VM in that it can't resolve the hostname -- but there is, obviously. >> >> Pkg against the base installed system works properly and have a decent number of packages installed (specifically git and its dependencies, which was loaded to grab the source tree of course.) >> >> Thanks in advance. >> >> -- >> Karl Denninger >> karl@denninger.net >> /The Market Ticker/ >> /[S/MIME encrypted email preferred]/ >> >> >> >> > > > > Pkg -c . > This does chroot. Did you configure /etc/resolv.conf in the arm64 mount? > > try chroot . ping pkg.freebsd.org in that same directory. > > Regards, > Ronald > I don't have experience with crochet, but I found this documentation about crochet, pkg and resolv.conf. https://github.com/freebsd/crochet?tab=readme-ov-file#using-pkg Happy hacking! Ronald. ------=_Part_1713_1753761224.1721114720914 Content-Type: text/html; charset=us-ascii Content-Transfer-Encoding: 7bit <html><head></head><body><br> <p><strong>Van:</strong> Ronald Klop <ronald-lists@klop.ws><br> <strong>Datum:</strong> dinsdag, 16 juli 2024 08:46<br> <strong>Aan:</strong> Karl Denninger <karl@denninger.net><br> <strong>CC:</strong> "freebsd-pkg@freebsd.org" <freebsd-pkg@freebsd.org><br> <strong>Onderwerp:</strong> Re: Probably something stupid -- cannot find SRV records and fails</p> <blockquote style="padding-right: 0px; padding-left: 5px; margin-left: 5px; border-left: #000000 2px solid; margin-right: 0px"> <div class="MessageRFC822Viewer" id="P"> <div class="MultipartAlternativeViewer"> <div class="TextHTMLViewer" id="P.P.P"> <p><small><strong>Van:</strong> Karl Denninger <karl@denninger.net><br> <strong>Datum:</strong> 16 juli 2024 01:01<br> <strong>Aan:</strong> "freebsd-pkg@freebsd.org" <freebsd-pkg@freebsd.org><br> <strong>Onderwerp:</strong> Probably something stupid -- cannot find SRV records and fails</small></p> <blockquote style="margin-left: 5px; border-left: 3px solid #ccc; margin-right: 0px; padding-left: 5px;"> <div class="MessageRFC822Viewer do_not_remove" id="P"> <div class="MultipartMixedViewer do_not_remove"> <div class="MultipartMixedViewer do_not_remove"> <div class="TextPlainViewer do_not_remove" id="P.P.P1.P1">I have a Crochet build environment that runs on a native FreeBSD OS (on metal) without problems and has for quite some time. I'm trying to move that build environment to a VM running on VirtualBox; the host is Windows 11.<br> <br> Everything appears to work as expected normally, including pulling the source from HEAD, setting up a worktree for stable/14, doing a buildworld/kernel and such and in fact the crossbuild for ARM64 via Crochet -- except the package grab at the end for a set of packages I want on the embedded media output once the install of the system itself into the md is complete.<br> <br> Again this works fine on my long-standing build box that runs on actual metal, and as far as I can tell there isn't any difference -- I have the same setup (to grab "latest" rather than "quarterly") in /etc/pkg/FreeBSD.conf, for example.<br> <br> I am getting this, which is a replay (by hand) of what Crochet does at that point -- it does not chroot during the build and runs in the native (in this case AMD64) context, but with the "-c" flag to the mounted install filesystem for the pkg command (which is on an md):<br> <br> # pwd<br> /work/OBJ/ARM64-14-STABLE/_.mount.freebsd<br> # env ASSUME_ALWAYS_YES=YES pkg -d -c . install rsync sshbuard ntimed ffmpeg mpg321 git<br> DBG(1)[53612]> pkg initialized<br> Updating FreeBSD repository catalogue...<br> DBG(1)[53612]> PkgRepo: verifying update for FreeBSD<br> DBG(1)[53612]> PkgRepo: need forced update of FreeBSD<br> DBG(1)[53612]> Pkgrepo, begin update of '/var/db/pkg/repos/FreeBSD/db'<br> DBG(1)[53612]> Request to fetch pkg+<a href="https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/meta.conf">https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/meta.conf</a><br>; DBG(1)[53612]> curl_open<br> pkg: No SRV record found for the repo 'FreeBSD'<br> DBG(1)[53612]> Fetch: fetcher used: pkg+https<br> DBG(1)[53612]> curl> fetching <a href="https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/meta.conf">https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/meta.conf</a><br>; <br> DBG(1)[53612]> CURL> No mirror set url to <a href="https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/meta.conf">https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/meta.conf</a><br>; <br> DBG(1)[53612]> CURL> attempting to fetch from <a href="https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/meta.conf">https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/meta.conf</a>, left retry 3<br> <br> * Couldn't find host pkg.FreeBSD.org in the .netrc file; using defaults<br> * Could not resolve host: pkg.FreeBSD.org<br> * Closing connection<br> DBG(1)[53612]> CURL> No mirror set url to <a href="https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/meta.conf">https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/meta.conf</a><br>; <br> DBG(1)[53612]> CURL> attempting to fetch from <a href="https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/meta.conf">https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/meta.conf</a>, left retry 2<br> <br> * Couldn't find host pkg.FreeBSD.org in the .netrc file; using defaults<br> * Could not resolve host: pkg.FreeBSD.org<br> * Closing connection<br> DBG(1)[53612]> CURL> No mirror set url to <a href="https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/meta.conf">https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/meta.conf</a><br>; <br> DBG(1)[53612]> CURL> attempting to fetch from <a href="https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/meta.conf">https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/meta.conf</a>, left retry 1<br> <br> * Couldn't find host pkg.FreeBSD.org in the .netrc file; using defaults<br> * Could not resolve host: pkg.FreeBSD.org<br> * Closing connection<br> pkg: An error occured while fetching package<br> DBG(1)[53612]> Request to fetch pkg+<a href="https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/meta.txz">https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/meta.txz</a><br>; pkg: packagesite URL error for pkg+<a href="https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/meta.txz">https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/meta.txz</a>; -- pkg+:// implies SRV mirror type<br> repository FreeBSD has no meta file, using default settings<br> DBG(1)[53612]> Request to fetch pkg+<a href="https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/data.pkg">https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/data.pkg</a><br>; pkg: packagesite URL error for pkg+<a href="https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/data.pkg">https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/data.pkg</a>; -- pkg+:// implies SRV mirror type<br> DBG(1)[53612]> Request to fetch pkg+<a href="https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/data.txz">https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/data.txz</a><br>; pkg: packagesite URL error for pkg+<a href="https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/data.txz">https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/data.txz</a>; -- pkg+:// implies SRV mirror type<br> DBG(1)[53612]> Request to fetch pkg+<a href="https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/packagesite.pkg">https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/packagesite.pkg</a><br>; pkg: packagesite URL error for pkg+<a href="https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/packagesite.pkg">https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/packagesite.pkg</a>; -- pkg+:// implies SRV mirror type<br> DBG(1)[53612]> Request to fetch pkg+<a href="https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/packagesite.txz">https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/packagesite.txz</a><br>; pkg: packagesite URL error for pkg+<a href="https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/packagesite.txz">https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/packagesite.txz</a>; -- pkg+:// implies SRV mirror type<br> Unable to update repository FreeBSD<br> Error updating repositories!<br> #<br> <br> What I don't understand here is that it works perfectly fine on a native host, and I don't see anything obvious. I can ping pkg.freebsd.org:<br> <br> # ping pkg.freebsd.org<br> PING pkgmir.geo.freebsd.org (173.228.147.98): 56 data bytes<br> 64 bytes from 173.228.147.98: icmp_seq=0 ttl=49 time=58.336 ms<br> ^C<br> --- pkgmir.geo.freebsd.org ping statistics ---<br> 1 packets transmitted, 1 packets received, 0.0% packet loss<br> round-trip min/avg/max/stddev = 58.336/58.336/58.336/0.000 ms<br> <br> Further, a "fetch" against the first requested file (meta.conf) that the pkg command complains about succeeds:<br> <br> # fetch <a href="https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/meta.conf">https://pkg.FreeBSD.org/FreeBSD:14:aarch64/latest/meta.conf</a><br>; meta.conf 178 B 1687 kBps 00s<br> <br> Any ideas on where to look? I turned debugging on with "-d" because the original build was not giving me any idea of what was happening, but this appears to imply there's no connectivity out of the VM in that it can't resolve the hostname -- but there is, obviously.<br> <br> Pkg against the base installed system works properly and have a decent number of packages installed (specifically git and its dependencies, which was loaded to grab the source tree of course.)<br> <br> Thanks in advance.<br> <br> -- <br> Karl Denninger<br> karl@denninger.net<br> /The Market Ticker/<br> /[S/MIME encrypted email preferred]/</div> <hr></div> <div class="DefaultViewer do_not_remove"> </div> </div> </div> </blockquote> <div> </div> <div> </div> Pkg -c . <div>This does chroot. Did you configure /etc/resolv.conf in the arm64 mount?</div> <div> </div> <div>try chroot . ping pkg.freebsd.org in that same directory. </div> <div> </div> <div>Regards,</div> <div>Ronald<br> </div> </div> </div> </div> </blockquote> <br> <br> I don't have experience with crochet, but I found this documentation about crochet, pkg and resolv.conf.<br> <br> <a href="https://github.com/freebsd/crochet?tab=readme-ov-file#using-pkg">https://github.com/freebsd/crochet?tab=readme-ov-file#using-pkg</a><br>; <br> Happy hacking!<br> Ronald.<br> </body></html> ------=_Part_1713_1753761224.1721114720914--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?1053288469.1714.1721114720975>