Skip site navigation (1)Skip section navigation (2)
Date:      Sun, 28 Jan 2024 14:23:45 -0700
From:      Warner Losh <imp@bsdimp.com>
To:        Guido Falsi <mad@madpilot.net>
Cc:        emulation@freebsd.org, "freebsd-arm@freebsd.org" <freebsd-arm@freebsd.org>
Subject:   Re: qemu-user-static aarch64 lockup/race? (was Re: Python failure in poudriere on arm64 (via qemu-user-static cross compiling))
Message-ID:  <CANCZdfr-0w2EMa=_hFT3p4gFSDO-P1Yf8Vb-1eLiwRVomo1Jfg@mail.gmail.com>
In-Reply-To: <79a5eb0f-d04e-4c1a-9d8a-185e1fb4e4a2@madpilot.net>
References:  <6a33726b-eb6f-418e-9fbd-6d0b9b4bfaa8@madpilot.net> <0fc7f929-6e5b-4a33-97d2-8a9c0c07d524@madpilot.net> <79a5eb0f-d04e-4c1a-9d8a-185e1fb4e4a2@madpilot.net>

next in thread | previous in thread | raw e-mail | index | archive | help
--000000000000a6716d0610082573
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

On Sun, Jan 28, 2024, 12:38=E2=80=AFPM Guido Falsi <mad@madpilot.net> wrote=
:

> On 28/01/24 15:15, Guido Falsi wrote:
> > Hi all, again,
> >
> > I have some more findings about this, I'm top posting because the old
> > message is not really that much relevant anymore.
> >
> > I'm now running a machine with head (commit
> > b32d49cfbaa0437d08e65e7cd7c82c5951b1a852 Jan 25th), poudriere installed
> > in it, machine is amd64, with an arm64 jail, 14.0-RELEASE, installed
> > from official distribution binaries (https download method), with cross
> > tools.
> >
> > To make sure everything is aligned I rebuild everything: updated head,
> > rebuild cross tools in the jail, recompiled all ports for the host
> > architecture and force reinstalled them, especially qemu-user-static,
> > cleaned up all packages for the arm64 jail.
> >
> > If I missed something important please point it out.
> >
> > I have made some more tests and I'm getting python failures in poudrier=
e
> > like the one described below from time to time (don't have hard stats
> > but feels like 50% chance). If I get past that it usually is able to
> > build all the not many packages, but locks up at:
> >
> > Creating repository in /tmp/packages:   0%
> >
>
> BTW, forgot to mention last time this worked without issue was around
> 20th December.
>

I think this is a bsd-user issue. There is a race somewhere in that code
that causes the hangs. I'd love a reproducible test case that is somewhat
smaller than python... there are bigger races with the newer stuff and I've
not had the time to chase it there either. =F0=9F=98=9E

Warner

Warner

Warner

--=20
> Guido Falsi <mad@madpilot.net>
>
>
>

--000000000000a6716d0610082573
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"auto"><div><br><br><div class=3D"gmail_quote"><div dir=3D"ltr" =
class=3D"gmail_attr">On Sun, Jan 28, 2024, 12:38=E2=80=AFPM Guido Falsi &lt=
;<a href=3D"mailto:mad@madpilot.net">mad@madpilot.net</a>&gt; wrote:<br></d=
iv><blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left=
:1px #ccc solid;padding-left:1ex">On 28/01/24 15:15, Guido Falsi wrote:<br>
&gt; Hi all, again,<br>
&gt; <br>
&gt; I have some more findings about this, I&#39;m top posting because the =
old <br>
&gt; message is not really that much relevant anymore.<br>
&gt; <br>
&gt; I&#39;m now running a machine with head (commit <br>
&gt; b32d49cfbaa0437d08e65e7cd7c82c5951b1a852 Jan 25th), poudriere installe=
d <br>
&gt; in it, machine is amd64, with an arm64 jail, 14.0-RELEASE, installed <=
br>
&gt; from official distribution binaries (https download method), with cros=
s <br>
&gt; tools.<br>
&gt; <br>
&gt; To make sure everything is aligned I rebuild everything: updated head,=
 <br>
&gt; rebuild cross tools in the jail, recompiled all ports for the host <br=
>
&gt; architecture and force reinstalled them, especially qemu-user-static, =
<br>
&gt; cleaned up all packages for the arm64 jail.<br>
&gt; <br>
&gt; If I missed something important please point it out.<br>
&gt; <br>
&gt; I have made some more tests and I&#39;m getting python failures in pou=
driere <br>
&gt; like the one described below from time to time (don&#39;t have hard st=
ats <br>
&gt; but feels like 50% chance). If I get past that it usually is able to <=
br>
&gt; build all the not many packages, but locks up at:<br>
&gt; <br>
&gt; Creating repository in /tmp/packages:=C2=A0=C2=A0 0%<br>
&gt; <br>
<br>
BTW, forgot to mention last time this worked without issue was around <br>
20th December.<br></blockquote></div></div><div dir=3D"auto"><br></div><div=
 dir=3D"auto">I think this is a bsd-user issue. There is a race somewhere i=
n that code that causes the hangs. I&#39;d love a reproducible test case th=
at is somewhat smaller than python... there are bigger races with the newer=
 stuff and I&#39;ve not had the time to chase it there either. =F0=9F=98=9E=
</div><div dir=3D"auto"><br></div><div dir=3D"auto">Warner=C2=A0</div><div =
dir=3D"auto"><br></div><div dir=3D"auto">Warner</div><div dir=3D"auto"><br>=
</div><div dir=3D"auto">Warner</div><div dir=3D"auto"><br></div><div dir=3D=
"auto"><div class=3D"gmail_quote"><blockquote class=3D"gmail_quote" style=
=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
-- <br>
Guido Falsi &lt;<a href=3D"mailto:mad@madpilot.net" target=3D"_blank" rel=
=3D"noreferrer">mad@madpilot.net</a>&gt;<br>
<br>
<br>
</blockquote></div></div></div>

--000000000000a6716d0610082573--



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CANCZdfr-0w2EMa=_hFT3p4gFSDO-P1Yf8Vb-1eLiwRVomo1Jfg>