Skip site navigation (1)Skip section navigation (2)
Date:      Sun, 18 Jun 2023 17:10:42 -0300
From:      "Danilo G. Baio" <dbaio@FreeBSD.org>
To:        "Michael Gmelin" <grembo@freebsd.org>
Cc:        "Yuri Victorovich" <yuri@freebsd.org>, "Moin Rahman" <bofh@freebsd.org>, "FreeBSD Cluster Administrators" <clusteradm@freebsd.org>, "ports@freebsd.org" <ports@freebsd.org>
Subject:   Re: Portscout is stuck
Message-ID:  <2be975e4-2730-4e4f-9336-b2978d2372c5@app.fastmail.com>
In-Reply-To: <FC6B343E-EA34-43EB-BCC6-A2070EB2026D@freebsd.org>
References:  <1f0225fd-6bb4-49ad-bfd5-215cf0833f5f@app.fastmail.com> <FC6B343E-EA34-43EB-BCC6-A2070EB2026D@freebsd.org>

next in thread | previous in thread | raw e-mail | index | archive | help


On Sat, Jun 17, 2023, at 04:11, Michael Gmelin wrote:
>> On 17. Jun 2023, at 02:27, Danilo G. Baio <dbaio@freebsd.org> wrote:
>>=20
>> =EF=BB=BF
>>=20
>>> On Fri, Jun 16, 2023, at 17:55, Yuri wrote:
>>> It looks like portscout is stuck again.
>>>=20
>>> The numbers changed once 27+ hours ago, and didn't change again.
>>>=20
>>> Normally portscount updates numbers at least several times a day.
>>=20
>>=20
>>=20
>> The check command was stuck, running for more than a day.
>>=20
>> I got a few errors, but we need to increase the debug.
>>=20
>> + /usr/bin/lockf -t 1800 /tmp/.portscout.build.lock /usr/local/bin/po=
rtscout build
>> Insufficient data for port java/bootstrap-openjdk8: missing version
>> Bad limitw value provided by portconfig variable in port textproc/gsp=
ell
>>=20
>> + /usr/bin/lockf -t 1800 /tmp/.portscout.build.lock /usr/local/bin/po=
rtscout rebuild
>> + /usr/bin/lockf -t 1800 /tmp/.portsout.check.lock /usr/local/bin/por=
tscout check
>>    no element found at line 762, column 99, byte 76060:
>>        <item>
>>          <title><![CDATA[/pptpd/pptpd-1.2.2/pptpd-1.2.2-0.src.rpm]]><=
/title>
>>          <link>https://sourceforge.net/projects/poptop/files/pptpd/pp=
tpd-1.2.2/pptpd-1.2.2-0.src.rpm/d
>>    =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D^
>>     at /usr/local/lib/perl5/site_perl/mach/5.32/XML/Parser.pm line 18=
7.
>>=20
>>    unclosed token at line 328, column 6, byte 30972:
>>          <files:sf-file-id xmlns:files=3D"https://sourceforge.net/api=
/files.rdf#">31999936</files:sf-file-id>
>>          <files:extra-info xmlns:files=3D"https://sourceforge.net/api=
/files.rdf#">empty (Zip archive data)</files:extra-info>
>>          <media:content xmlns:media=3D"http://video.search.yahoo.com/=
mrss/" type=3D"application/zip;
>>    =3D=3D=3D=3D=3D^
>>     at /usr/local/lib/perl5/site_perl/mach/5.32/XML/Parser.pm line 18=
7.
>>=20
>>=20
>
> Maybe we=E2=80=99re rate limited by one of the big sites (e.g., github=
). Is/are=20
> auth token(s) valid?
>
> In case it=E2=80=99s really hanging, you might be able to tell how far=
 it got=20
> based on the db.


I've decreased the timeout of HTTP and FTP requests.

Yesterday I cleaned up some MASTER_SITES that don't resolve DNS.

And the last portscout check I manually did today was faster.

Many entries still need to be fixed/removed; here is the current list so=
 everyone can help.

https://people.freebsd.org/~dbaio/portscout_host_does_not_resolve-2023-0=
6-18.txt

Regards.
--=20
Danilo G. Baio



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?2be975e4-2730-4e4f-9336-b2978d2372c5>