Skip site navigation (1)Skip section navigation (2)
Date:      Tue, 20 Jun 2023 18:06:22 +0600
From:      Moin Rahman <bofh@freebsd.org>
To:        "Danilo G. Baio" <dbaio@FreeBSD.org>
Cc:        Michael Gmelin <grembo@freebsd.org>, Yuri Victorovich <yuri@freebsd.org>, FreeBSD Cluster Administrators <clusteradm@freebsd.org>, "ports@freebsd.org" <ports@freebsd.org>
Subject:   Re: Portscout is stuck
Message-ID:  <E2C8DA0A-A350-4D9F-82E9-73E48A36C7E7@freebsd.org>
In-Reply-To: <2be975e4-2730-4e4f-9336-b2978d2372c5@app.fastmail.com>
References:  <1f0225fd-6bb4-49ad-bfd5-215cf0833f5f@app.fastmail.com> <FC6B343E-EA34-43EB-BCC6-A2070EB2026D@freebsd.org> <2be975e4-2730-4e4f-9336-b2978d2372c5@app.fastmail.com>

next in thread | previous in thread | raw e-mail | index | archive | help

--Apple-Mail=_FA81E6F2-4CD2-4819-A163-7892199C026D
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
	charset=utf-8



> On Jun 19, 2023, at 2:10 AM, Danilo G. Baio <dbaio@FreeBSD.org> wrote:
>=20
>=20
>=20
> On Sat, Jun 17, 2023, at 04:11, Michael Gmelin wrote:
>>> On 17. Jun 2023, at 02:27, Danilo G. Baio <dbaio@freebsd.org> wrote:
>>>=20
>>> =EF=BB=BF
>>>=20
>>>> On Fri, Jun 16, 2023, at 17:55, Yuri wrote:
>>>> It looks like portscout is stuck again.
>>>>=20
>>>> The numbers changed once 27+ hours ago, and didn't change again.
>>>>=20
>>>> Normally portscount updates numbers at least several times a day.
>>>=20
>>>=20
>>>=20
>>> The check command was stuck, running for more than a day.
>>>=20
>>> I got a few errors, but we need to increase the debug.
>>>=20
>>> + /usr/bin/lockf -t 1800 /tmp/.portscout.build.lock =
/usr/local/bin/portscout build
>>> Insufficient data for port java/bootstrap-openjdk8: missing version
>>> Bad limitw value provided by portconfig variable in port =
textproc/gspell
>>>=20
>>> + /usr/bin/lockf -t 1800 /tmp/.portscout.build.lock =
/usr/local/bin/portscout rebuild
>>> + /usr/bin/lockf -t 1800 /tmp/.portsout.check.lock =
/usr/local/bin/portscout check
>>>   no element found at line 762, column 99, byte 76060:
>>>       <item>
>>>         =
<title><![CDATA[/pptpd/pptpd-1.2.2/pptpd-1.2.2-0.src.rpm]]></title>
>>>         =
<link>https://sourceforge.net/projects/poptop/files/pptpd/pptpd-1.2.2/pptp=
d-1.2.2-0.src.rpm/d
>>>   =
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D^
>>>    at /usr/local/lib/perl5/site_perl/mach/5.32/XML/Parser.pm line =
187.
>>>=20
>>>   unclosed token at line 328, column 6, byte 30972:
>>>         <files:sf-file-id =
xmlns:files=3D"https://sourceforge.net/api/files.rdf#">31999936</files:sf-=
file-id>
>>>         <files:extra-info =
xmlns:files=3D"https://sourceforge.net/api/files.rdf#">empty (Zip =
archive data)</files:extra-info>
>>>         <media:content =
xmlns:media=3D"http://video.search.yahoo.com/mrss/" =
type=3D"application/zip;
>>>   =3D=3D=3D=3D=3D^
>>>    at /usr/local/lib/perl5/site_perl/mach/5.32/XML/Parser.pm line =
187.
>>>=20
>>>=20
>>=20
>> Maybe we=E2=80=99re rate limited by one of the big sites (e.g., =
github). Is/are
>> auth token(s) valid?
>>=20
>> In case it=E2=80=99s really hanging, you might be able to tell how =
far it got
>> based on the db.
>=20
>=20
> I've decreased the timeout of HTTP and FTP requests.
>=20
> Yesterday I cleaned up some MASTER_SITES that don't resolve DNS.
>=20
> And the last portscout check I manually did today was faster.
>=20
> Many entries still need to be fixed/removed; here is the current list =
so everyone can help.
>=20
> =
https://people.freebsd.org/~dbaio/portscout_host_does_not_resolve-2023-06-=
18.txt
Thanks for the detailed debugging. I will try to see how many I can axe.


> Regards.
> --
> Danilo G. Baio
>=20


--Apple-Mail=_FA81E6F2-4CD2-4819-A163-7892199C026D
Content-Transfer-Encoding: 7bit
Content-Disposition: attachment;
	filename=signature.asc
Content-Type: application/pgp-signature;
	name=signature.asc
Content-Description: Message signed with OpenPGP

-----BEGIN PGP SIGNATURE-----

iQKTBAEBCgB9FiEETfdREoUGjQZKBS+fvbm1phfAvJEFAmSRlj5fFIAAAAAALgAo
aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldDRE
Rjc1MTEyODUwNjhEMDY0QTA1MkY5RkJEQjlCNUE2MTdDMEJDOTEACgkQvbm1phfA
vJHGQw/+O2rk4wYkKmtCbRxdKkkh/63xcO2cJp+A9/kIfzEKvFUlT2IQf3EXCsMI
UbG8qpu+9QNtKHoJQCcFXBTe7RyNBdlpnAel1UbtWjr1SLWWKruJD7hkfQRsPUC0
YdxZXVU34o+aw3ExOtjqWDBDQ8lC1O9t+4bt7gg3G3j9e7PaqwTH2aaue5bQ2sfK
mp5NgA8IUg3CdPKgZ3osc2vzUoq+IqIQdVzX65ocuY7rH2WPZgPxW7PTq38o/H4s
xZ8VBaQVobdG94CPUWnHhVU0sFPSeQtP482wAo/jZb8n7ZpnW3vYVWIVKKDaMIL0
CzvOGbzLPZP8V1RpbAxb+ybEFUJbqD4d1Bv16Edw7eg3lHuE2Zn9hIfyMOWpM5KM
i0AtIsIWsRGhoCIVtkLrfo0fHwjEqc8kvegKrzyPwJvdBJ84tQgflPwYotn00rim
ZambQRTdkujiNz/WFdPT8Q8ps1e8BPWXzX5bBj+KRaoA3QKFgMSCWkYUM8Q9EM0M
a5J53igGxQMYWLNTdy8beclbvKmnONXprw1LkSRSR1Tdq71qLJrPoOq0XGY3kQxO
mwhZrCXwM6T9eSSEKnshVYoBwwFHz4Mz8Ax9EIVyjmn3mwkabgGhhjY7r/49TH6p
rXg5XThXquDKyAxUc39G1wgtf+M1NO7soOS+X8eW8mxyr+CMFP8=
=P5pg
-----END PGP SIGNATURE-----

--Apple-Mail=_FA81E6F2-4CD2-4819-A163-7892199C026D--



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?E2C8DA0A-A350-4D9F-82E9-73E48A36C7E7>