From nobody Mon Jan 29 01:10:45 2024 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TNVc43tr8z57jRD for ; Mon, 29 Jan 2024 01:11:00 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-ed1-x52c.google.com (mail-ed1-x52c.google.com [IPv6:2a00:1450:4864:20::52c]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4TNVc36sgMz4syf for ; Mon, 29 Jan 2024 01:10:59 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-ed1-x52c.google.com with SMTP id 4fb4d7f45d1cf-554fe147ddeso1907240a12.3 for ; Sun, 28 Jan 2024 17:10:59 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20230601.gappssmtp.com; s=20230601; t=1706490657; x=1707095457; darn=freebsd.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=5D02TtyuLW5ZKQD1laSUcZWNt/UHpwVXXDyx3e1D3n4=; b=YXQMKVj/9YXhjfwIX0+ijSCn7Gl31vSLCfiemPxKgZt4T/D9UsZx67FRB6BVbk1qcm wIjX0oi6xqu/0j21DTAdsuL1pqRBc4aStMmIVlamezjicqEkUagPDWHQLAqlzYMc1D+0 KyhfVHPvMdIGHejupFnPA/FCO7BtMh/wY9p+BWR54l2fgcTyg8V6D2VSBzoOtqbMlx7P 94pRWqcE/bauNTPpr+wGb444oGxOSCBTqPViSj2lYxDCBkmcz6BdSUBT8MPDmNtwEJQR tTxmPEEYiQE1/XsvPoGxUQTwjV0KOxBBVlw8e4VxVuoFbm9DiH6fNBJDVYl/dsLauUtb LRiw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1706490657; x=1707095457; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=5D02TtyuLW5ZKQD1laSUcZWNt/UHpwVXXDyx3e1D3n4=; b=PZ3MlQYNQC0ZbcLRfTDZSMQeS82GfAxUAbXzerA8EshkhyXVD0D7NLwGNwnTydpKsS MJa40O02IH66wkcVN1G7AbxY+SqhGyGHRUE9+yyvw35T0LSasBd8i60KGLaME7X+sFOS /nvWob/n5DjRuNvfGXax8Gt2ruaqAyq2NPeGiHR0VWsXIN6wPo0NgB8sSvtRhdsxKzig WoJpOHZspK0oo0es+6FvsGcWej1x/EiFS0sskL2im2zoCkrNWJes5Lwb7XeLSQYUokRw JnafQJiyEC1lRnS5tX1x+ttsKgGbHvEu/WpHvefnIX1ZWTL/U7DJHKCCBBQ90seqkvQx aLRA== X-Gm-Message-State: AOJu0Yykl6DKj7D9Fgit5HRtLtrfLMnkuoBiY4u6IhbCMa3N5++X3V9w cL4KmOkXNJGclJN78+XksVRiws8qQevbyTNb1Sa/TJIEaEMr8SYxRIIlL8FVoXNGZLc8zDmDcaU IiMTeVKK++k/KOIJ9tbfFlXsrQ0WLw2nFgPlIrQ== X-Google-Smtp-Source: AGHT+IH5cRe/gjlTJynX2PH4Odq6q+sRtnNs/uDxLHJp81pSe5NJlaMxEDQG6yTCqJr/s9DKp5jm/LQyQiDSyJMVXXc= X-Received: by 2002:aa7:d4c1:0:b0:55c:c474:f89b with SMTP id t1-20020aa7d4c1000000b0055cc474f89bmr2776074edr.38.1706490656492; Sun, 28 Jan 2024 17:10:56 -0800 (PST) List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 References: <6a33726b-eb6f-418e-9fbd-6d0b9b4bfaa8@madpilot.net> <0fc7f929-6e5b-4a33-97d2-8a9c0c07d524@madpilot.net> <79a5eb0f-d04e-4c1a-9d8a-185e1fb4e4a2@madpilot.net> <5ef2ab66-25ef-45f1-aa5a-4b614eab2f40@madpilot.net> In-Reply-To: From: Warner Losh Date: Sun, 28 Jan 2024 18:10:45 -0700 Message-ID: Subject: Re: qemu-user-static aarch64 lockup/race? (was Re: Python failure in poudriere on arm64 (via qemu-user-static cross compiling)) To: Nathan Reilly-list Cc: Guido Falsi , emulation@freebsd.org, "freebsd-arm@freebsd.org" , freebsd-pkg@freebsd.org Content-Type: multipart/alternative; boundary="00000000000064a28406100b5186" X-Rspamd-Queue-Id: 4TNVc36sgMz4syf X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] --00000000000064a28406100b5186 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Sun, Jan 28, 2024 at 4:45=E2=80=AFPM Nathan Reilly-list wrote: > > > On 29 Jan 2024, at 8:43=E2=80=AFam, Guido Falsi wrote: > On 28/01/24 22:34, Guido Falsi wrote: > > On 28/01/24 22:23, Warner Losh wrote: > > On Sun, Jan 28, 2024, 12:38=E2=80=AFPM Guido Falsi mad@madpilot.net>> wrote: > > On 28/01/24 15:15, Guido Falsi wrote: > [snip] > > Creating repository in /tmp/packages: 0% > > > > BTW, forgot to mention last time this worked without issue was around > 20th December. > > > I think this is a bsd-user issue. There is a race somewhere in that code > that causes the hangs. I'd love a reproducible test case that is somewhat > smaller than python... there are bigger races with the newer stuff and I'= ve > not had the time to chase it there either. =F0=9F=98=9E > > First of all thanks for your feedback. It encourages me having someone > else with better knowledge about this confirm that a race condition is > actually a possible cause! > Strange this has not been happening up to mid December. > My main and fully reproducible use case is actually mostly with pkg. > at the end of the run poudriere runs `pkg repo` to create the meta files > and sign the repo. It forks itself (ncpus + 2 I guess, even forcing it to= 1 > worker I see three processes), and then locks up, with all the processes > stopping using CPU (ps output is in my message) > I guess this can be reproduced with any poudriere repo with at least more > than ncpus packages in it. can also be reproduced using `poudriere pkgcle= an > -u ` > If that does not work I'm not sure how to reproduce it in other ways, but > I can try writing some code mocking what pkg seems to be doing, not an > expert at such things, though. > > > In case it helps further norrow doen things, It looks like the lockup is > happening somewhere around here: > > > https://github.com/freebsd/pkg/blob/56fa3f87d9d9644348b89680dfd8af47a860e= e82/libpkg/pkg_repo_create.c#L778 > > and/or in the pkg_create_repo_worker() function here: > > > https://github.com/freebsd/pkg/blob/56fa3f87d9d9644348b89680dfd8af47a860e= e82/libpkg/pkg_repo_create.c#L341 > > > (I'm trying to spare you the time needed to find the actual code being > executed, I guess you would have identified this in a few minutes yoursel= f, > but I'm trying to make myself useful) > > > > There appears to be a GitHub issue for poudriere with this, but seems to > be looking in another direction. > > https://github.com/freebsd/poudriere/issues/1009 > There's a FreeBSD bug saying this is happening w/o qemu in the loop. https://bugs.freebsd.org/276690 at least I think that's similar. Warner --00000000000064a28406100b5186 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


=
On Sun, Jan 28, 2024 at 4:45=E2=80=AF= PM Nathan Reilly-list <lists@nreill= y.com> wrote:


On 29 Jan 2024, at 8:43=E2=80=AFam, Gu= ido Falsi <mad@mad= pilot.net> wrote:
On 28/01/24 22:34, Guido Falsi wrot= e:
On 28/01/24 22:23, Warner Losh wrote:On Sun, Jan 28, 2024, 12:38=E2=80=AFPM Guido Falsi <= mad@madpilot.net = <mailto:mad@madpil= ot.net>> wrote:

=C2=A0=C2=A0=C2=A0 On 28/01/24 15:15, Guid= o Falsi wrote:
=C2=A0 =C2=A0 [snip]
=C2=A0=C2=A0=C2=A0=C2=A0 > Cre= ating repository in /tmp/packages:=C2=A0=C2=A0 0%
=C2=A0=C2=A0=C2=A0=C2= =A0 >

=C2=A0=C2=A0=C2=A0 BTW, forgot to mention last time this wo= rked without issue was around
=C2=A0=C2=A0=C2=A0 20th December.

<= br>I think this is a bsd-user issue. There is a race somewhere in that code= that causes the hangs. I'd love a reproducible test case that is somew= hat smaller than python... there are bigger races with the newer stuff and = I've not had the time to chase it there either. =F0=9F=98=9E
First of all thanks for your feedback. It encourages me having someon= e else with better knowledge about this confirm that a race condition is ac= tually a possible cause!
Strange this has not been happening up to mid D= ecember.
My main and fully reproducible use case is actually mostly with= pkg.
at the end of the run poudriere runs `pkg repo` to create the meta= files and sign the repo. It forks itself (ncpus + 2 I guess, even forcing = it to 1 worker I see three processes), and then locks up, with all the proc= esses stopping using CPU (ps output is in my message)
I guess this can b= e reproduced with any poudriere repo with at least more than ncpus packages= in it. can also be reproduced using `poudriere pkgclean -u <etc>`If that does not work I'm not sure how to reproduce it in other ways, = but I can try=C2=A0 writing some code mocking what pkg seems to be doing, n= ot an expert at such things, though.

In case it helps f= urther norrow doen things, It looks like the lockup is happening somewhere = around here:

https://github.com/freebsd/pkg/blob/56fa3f87d9d9644348b89680dfd8af47= a860ee82/libpkg/pkg_repo_create.c#L778

and/or in the pkg_create_= repo_worker() function here:

https://github.com/freebsd/pkg/blob/56fa3f87d9d96443= 48b89680dfd8af47a860ee82/libpkg/pkg_repo_create.c#L341


(I= 9;m trying to spare you the time needed to find the actual code being execu= ted, I guess you would have identified this in a few minutes yourself, but = I'm trying to make myself useful)

=

There appears to be a GitHub issue for poudriere= =C2=A0with this, but seems to be looking in another direction.

There's a FreeBSD bug saying this is = happening w/o qemu in the loop. https://bugs.freebsd.org/276690 at least I think that's similar.

Warner
--00000000000064a28406100b5186-- From nobody Mon Jan 29 08:26:58 2024 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TNhHn4Wf2z58TGR; Mon, 29 Jan 2024 08:27:33 +0000 (UTC) (envelope-from mad@madpilot.net) Received: from mail.madpilot.net (vogon.madpilot.net [159.69.1.99]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4TNhHn2CYdz4fSh; Mon, 29 Jan 2024 08:27:33 +0000 (UTC) (envelope-from mad@madpilot.net) Authentication-Results: mx1.freebsd.org; none Received: from mail (mail [IPv6:fd5c:5351:d272::3]) by mail.madpilot.net (Postfix) with ESMTP id 4TNhH9558Jz6f8Z; Mon, 29 Jan 2024 09:27:01 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=madpilot.net; h= content-transfer-encoding:content-type:content-type:in-reply-to :from:from:references:content-language:subject:subject:date:date :message-id:received; s=bjowvop61wgh; t=1706516819; x= 1708331220; bh=mVr+HgxGgNrxo/9UQWcmU7j+1bBTRLVlQBE8VQGd5KA=; b=f PbxLF7legsod+BpyRNy13N/yD4SyzQQlB5SATnioR+cGPGf4lQLsQB5Ti5SgqsMP iz4AC1vIMm5Zzvoadffam98j8qhrvnWqAnxClsnQqhBd5fPkn9QhSzyOML5usuCf hHMKhhwCvsoZ1gq3aeGh/EDihO1MvWZRVqhpzoUIjxsAGoFrPv5vNmJGEU0KuBV/ 6EezCzCVxis4XdE9fY9GJ/MGg68dia6d6C+lJf5eJYrr+p/6nF7J8h0RDY6T8Hmt ATfrdAjSfgzTSbi6tR4rM1S+Clu0h8WIrOCKHoNcbCi5F4CP3fIW6g0i0MgrQ6en k9vSCCGf9URo7P8XtBOFA== Received: from mail.madpilot.net ([IPv6:fd5c:5351:d272::3]) by mail (mail.madpilot.net [IPv6:fd5c:5351:d272::3]) (amavisd-new, port 10026) with ESMTP id OAnQt_jFEwX4; Mon, 29 Jan 2024 09:26:59 +0100 (CET) Message-ID: Date: Mon, 29 Jan 2024 09:26:58 +0100 Subject: Re: qemu-user-static aarch64 lockup/race? (was Re: Python failure in poudriere on arm64 (via qemu-user-static cross compiling)) Content-Language: en-US, it To: Warner Losh , Nathan Reilly-list Cc: emulation@freebsd.org, "freebsd-arm@freebsd.org" , freebsd-pkg@freebsd.org References: <6a33726b-eb6f-418e-9fbd-6d0b9b4bfaa8@madpilot.net> <0fc7f929-6e5b-4a33-97d2-8a9c0c07d524@madpilot.net> <79a5eb0f-d04e-4c1a-9d8a-185e1fb4e4a2@madpilot.net> <5ef2ab66-25ef-45f1-aa5a-4b614eab2f40@madpilot.net> From: Guido Falsi Autocrypt: addr=mad@madpilot.net; keydata= xsBNBE+G+l0BCADi/WBQ0aRJfnE7LBPsM0G3m/m3Yx7OPu4iYFvS84xawmRHtCNjWIntsxuX fptkmEo3Rsw816WUrek8dxoUAYdHd+EcpBcnnDzfDH5LW/TZ4gbrFezrHPdRp7wdxi23GN80 qPwHEwXuF0X4Wy5V0OO8B6VT/nA0ADYnBDhXS52HGIJ/GCUjgqJn+phDTdCFLvrSFdmgx4Wl c0W5Z1p5cmDF9l8L/hc959AeyNf7I9dXnjekGM9gVv7UDUYzCifR3U8T0fnfdMmS8NeI9NC+ wuREpRO4lKOkTnj9TtQJRiptlhcHQiAlG1cFqs7EQo57Tqq6cxD1FycZJLuC32bGbgalABEB AAHNHkd1aWRvIEZhbHNpIDxtYWRAbWFkcGlsb3QubmV0PsLAeQQTAQgAIwIbAwIeAQIXgAUL CQgHAwUVCgkICwQWAgMBBQJS79AgAhkBAAoJEBrmhg5Wy9KTc0kH/RO64ORBlTbTHaUaOj8F Je5O5NU2Pt9Cyt5ZWBRvxntr1zPTJGKRPS9ihlIfqT4ZvEngQGp57EUyFbCpI0UWasTerImM tt5WACnGmCzUTB39UXx8Oy4b1EgWeTJQ747e/F1mQLXTNa6ijRBE9fYlTb4gAkPN88/wVV9v 3PZozKLTg16ghBzHM/P7Lk8L7clPEZChX1FTa/6eSt3nvzfCuTMZbBPJF/ph+q1KyPqRgVfh tyhu5dvgMoPz/ni41IfeSrkJTD5RXzdyGR9q4Z1NYeBsLkRjC4LxKAP5KqUsvlOUjKvO1byj ApYdMarol+IGkaSk9e3zVYAJkWKjn/ni8XbOwU0EUxB7QQEQAKFhrDceoPdK/IHDSmoj6SQY isvM7VdhcleS7E9DoEAVt7yMbf6HbbMVTTY6ckvwTWQssywLBXNVqxgc4WLJjzfUhgef+WE7 5M3+WFYlOVQLGZY/zEVgma1raYnOHNAOzeHLDmEXjbZP6vGAeDyBbGfQPpE7qGYZ7ubeT3Xw QO+PklcCrvOPj2ZPcAxGNS2xVU/LzONqCrJqLMJSIcCdsbiSP4G5PnDFHtMokaTY6OEr8OEQ fOAerhcHUa/z7Uu8YtmaqKH+QGkE/WEgaRqSiTnv0JOTD+DxehaqvoKPPZ++2NpCZMHB2i6A /xifmQwEiIjEXtcueBRzkNUQkxhqZyS13SrhocL9ydtaVPBzZatAEjUDDEJmAMLVFs45qfyh MiNapHJo2n3MW/E5omqCvEkDdWX/en3P7CK2TemeaDghMsgkNKax/z0wNo5UZCkOPOz0xpNi UilOVbkuezZZNg65741qee2lfXhQIaZ66yT7hphc/N/z3PIAtLeze4u1VR2EXAuZ2sWAdlKC NTlJMsaU/x70BV11Wd/ypnVzM68dfdQIIAj1iMFAD/lXGlEUmKXg5Ov2VQDlTntQoanCYrAg +8CttPzjrydgLZFq3hrtQmfc0se5yv1WHS69+BsUOG09RvvawUDZxUjW19kyeN9THaNRgow3 kSuArUp6zSmJABEBAAHCwF8EGAEIAAkFAlMQe0ECGwwACgkQGuaGDlbL0pMN5wgA4bCkX/qw EVC06ToeR6C2putmSWQMgpDaqrv65Hubo+QGmg2P4ewTYQQ4g6oYWS03qHxqVVWhKz7FjfrV +dH8qbCLfSgIcvdBha7ayGZVrsiuMLKGbw36fcmkZPpSDOfHcP0XH8Z+u9CWj0xUkTxAlZ/7 i6gYSUpG2JWNtdmE/X8VVEyXusCLwy0K0BI60A/4dRTIX3C4QKrJ3ZbUXegz70ynjHf+lQMZ 9IZKASoRMuS5FozPQh6abvmwZEPdf5I9riUElzvHrqJ8Bx0t3Pujdoth+yNHpnBxrtO8LkQd rQ58P0SwcaIX33T2U9pG8bhu5YVR88FQ8OQ0cEsPBpDncg== In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 4TNhHn2CYdz4fSh X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:24940, ipnet:159.69.0.0/16, country:DE] List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org On 29/01/24 02:10, Warner Losh wrote: > > > On Sun, Jan 28, 2024 at 4:45 PM Nathan Reilly-list > wrote: > > > >> On 29 Jan 2024, at 8:43 am, Guido Falsi > > wrote: >> On 28/01/24 22:34, Guido Falsi wrote: >>> On 28/01/24 22:23, Warner Losh wrote: >>>> On Sun, Jan 28, 2024, 12:38 PM Guido Falsi >>> >>> >> wrote: >>>> >>>>     On 28/01/24 15:15, Guido Falsi wrote: >>>>     [snip] >>>>      > Creating repository in /tmp/packages:   0% >>>>      > >>>> >>>>     BTW, forgot to mention last time this worked without issue >>>> was around >>>>     20th December. >>>> >>>> >>>> I think this is a bsd-user issue. There is a race somewhere in >>>> that code that causes the hangs. I'd love a reproducible test >>>> case that is somewhat smaller than python... there are bigger >>>> races with the newer stuff and I've not had the time to chase it >>>> there either. 😞 >>> First of all thanks for your feedback. It encourages me having >>> someone else with better knowledge about this confirm that a race >>> condition is actually a possible cause! >>> Strange this has not been happening up to mid December. >>> My main and fully reproducible use case is actually mostly with pkg. >>> at the end of the run poudriere runs `pkg repo` to create the >>> meta files and sign the repo. It forks itself (ncpus + 2 I guess, >>> even forcing it to 1 worker I see three processes), and then >>> locks up, with all the processes stopping using CPU (ps output is >>> in my message) >>> I guess this can be reproduced with any poudriere repo with at >>> least more than ncpus packages in it. can also be reproduced >>> using `poudriere pkgclean -u ` >>> If that does not work I'm not sure how to reproduce it in other >>> ways, but I can try  writing some code mocking what pkg seems to >>> be doing, not an expert at such things, though. >> >> In case it helps further norrow doen things, It looks like the >> lockup is happening somewhere around here: >> >> https://github.com/freebsd/pkg/blob/56fa3f87d9d9644348b89680dfd8af47a860ee82/libpkg/pkg_repo_create.c#L778 >> >> and/or in the pkg_create_repo_worker() function here: >> >> https://github.com/freebsd/pkg/blob/56fa3f87d9d9644348b89680dfd8af47a860ee82/libpkg/pkg_repo_create.c#L341 >> >> >> (I'm trying to spare you the time needed to find the actual code >> being executed, I guess you would have identified this in a few >> minutes yourself, but I'm trying to make myself useful) > > > There appears to be a GitHub issue for poudriere with this, but > seems to be looking in another direction. > > https://github.com/freebsd/poudriere/issues/1009 > > This one looks quite similar. In my case the ports/pkg are aligned between host and jail, in fact I have built them from the exact same git checkout. I noticed pkg head has been converted to using pthreads instead of fork, maybe that could help. I will make time to perform some testing. > > There's a FreeBSD bug saying this is happening w/o qemu in the loop. > https://bugs.freebsd.org/276690 at > least I think that's similar. There are similarities but they are looking at the compiler, which has no relation with pkg-repo getting stuck. That's what I'm concentrating on at present. Also the sporadic issue with python is not due to compiler, it is the python binaries running during the build causing issues. > > Warner -- Guido Falsi From nobody Mon Jan 29 15:47:57 2024 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TNt485mRPz58wGN; Mon, 29 Jan 2024 15:48:08 +0000 (UTC) (envelope-from mad@madpilot.net) Received: from mail.madpilot.net (vogon.madpilot.net [159.69.1.99]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4TNt474vNhz4jDp; Mon, 29 Jan 2024 15:48:07 +0000 (UTC) (envelope-from mad@madpilot.net) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=madpilot.net header.s=bjowvop61wgh header.b="n pvkqHQ"; dmarc=pass (policy=quarantine) header.from=madpilot.net; spf=pass (mx1.freebsd.org: domain of mad@madpilot.net designates 159.69.1.99 as permitted sender) smtp.mailfrom=mad@madpilot.net Received: from mail (mail [IPv6:fd5c:5351:d272::3]) by mail.madpilot.net (Postfix) with ESMTP id 4TNt404yLdz6dPK; Mon, 29 Jan 2024 16:48:00 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=madpilot.net; h= content-transfer-encoding:content-type:content-type:in-reply-to :content-language:references:from:from:subject:subject:date:date :message-id:received; s=bjowvop61wgh; t=1706543278; x= 1708357679; bh=9UEWlINe9QcufUzkwjCdZY2ErMlEqcXZ6hRYWUSihgs=; b=n pvkqHQ00jx2DwtiSot4W33EBKvxbTxdBbg5maYDZgK1vHXvWw9aTGG8QrpIJTOJO xmsLJOAHS0wwKPUeV1IYof3h9RoxtXDaw+Hj5fkTC9yVWiKqZPQ9fucawgZov6Wf xXlPoIuMTpeeohQhFA6aeDmSdnQ4pwIQQFysxM36BpN49NftTrp5RRLrC3Atn3w5 ynoG+1WQW3O/zpzJ4Rv1VAnCYdaXFs9HQ4bEALsrbWPnuS25HkA/+OCwLUDpx8oK NHK7hZUfk58vs8clO8Ck0z5KFtbocuH6GfRVzRkj8VIhl7Qij5ddAPEXoI96OXEY L0FCVoaw61BoWkjZQwEmQ== Received: from mail.madpilot.net ([IPv6:fd5c:5351:d272::3]) by mail (mail.madpilot.net [IPv6:fd5c:5351:d272::3]) (amavisd-new, port 10026) with ESMTP id ANWgLlsmXZ6F; Mon, 29 Jan 2024 16:47:58 +0100 (CET) Message-ID: <990427ae-0491-463e-92c7-c74700deb6fa@madpilot.net> Date: Mon, 29 Jan 2024 16:47:57 +0100 Subject: Re: qemu-user-static aarch64 lockup/race? (was Re: Python failure in poudriere on arm64 (via qemu-user-static cross compiling)) From: Guido Falsi To: Warner Losh , Nathan Reilly-list Cc: emulation@freebsd.org, "freebsd-arm@freebsd.org" , freebsd-pkg@freebsd.org References: <6a33726b-eb6f-418e-9fbd-6d0b9b4bfaa8@madpilot.net> <0fc7f929-6e5b-4a33-97d2-8a9c0c07d524@madpilot.net> <79a5eb0f-d04e-4c1a-9d8a-185e1fb4e4a2@madpilot.net> <5ef2ab66-25ef-45f1-aa5a-4b614eab2f40@madpilot.net> Content-Language: en-US, it Autocrypt: addr=mad@madpilot.net; keydata= xsBNBE+G+l0BCADi/WBQ0aRJfnE7LBPsM0G3m/m3Yx7OPu4iYFvS84xawmRHtCNjWIntsxuX fptkmEo3Rsw816WUrek8dxoUAYdHd+EcpBcnnDzfDH5LW/TZ4gbrFezrHPdRp7wdxi23GN80 qPwHEwXuF0X4Wy5V0OO8B6VT/nA0ADYnBDhXS52HGIJ/GCUjgqJn+phDTdCFLvrSFdmgx4Wl c0W5Z1p5cmDF9l8L/hc959AeyNf7I9dXnjekGM9gVv7UDUYzCifR3U8T0fnfdMmS8NeI9NC+ wuREpRO4lKOkTnj9TtQJRiptlhcHQiAlG1cFqs7EQo57Tqq6cxD1FycZJLuC32bGbgalABEB AAHNHkd1aWRvIEZhbHNpIDxtYWRAbWFkcGlsb3QubmV0PsLAeQQTAQgAIwIbAwIeAQIXgAUL CQgHAwUVCgkICwQWAgMBBQJS79AgAhkBAAoJEBrmhg5Wy9KTc0kH/RO64ORBlTbTHaUaOj8F Je5O5NU2Pt9Cyt5ZWBRvxntr1zPTJGKRPS9ihlIfqT4ZvEngQGp57EUyFbCpI0UWasTerImM tt5WACnGmCzUTB39UXx8Oy4b1EgWeTJQ747e/F1mQLXTNa6ijRBE9fYlTb4gAkPN88/wVV9v 3PZozKLTg16ghBzHM/P7Lk8L7clPEZChX1FTa/6eSt3nvzfCuTMZbBPJF/ph+q1KyPqRgVfh tyhu5dvgMoPz/ni41IfeSrkJTD5RXzdyGR9q4Z1NYeBsLkRjC4LxKAP5KqUsvlOUjKvO1byj ApYdMarol+IGkaSk9e3zVYAJkWKjn/ni8XbOwU0EUxB7QQEQAKFhrDceoPdK/IHDSmoj6SQY isvM7VdhcleS7E9DoEAVt7yMbf6HbbMVTTY6ckvwTWQssywLBXNVqxgc4WLJjzfUhgef+WE7 5M3+WFYlOVQLGZY/zEVgma1raYnOHNAOzeHLDmEXjbZP6vGAeDyBbGfQPpE7qGYZ7ubeT3Xw QO+PklcCrvOPj2ZPcAxGNS2xVU/LzONqCrJqLMJSIcCdsbiSP4G5PnDFHtMokaTY6OEr8OEQ fOAerhcHUa/z7Uu8YtmaqKH+QGkE/WEgaRqSiTnv0JOTD+DxehaqvoKPPZ++2NpCZMHB2i6A /xifmQwEiIjEXtcueBRzkNUQkxhqZyS13SrhocL9ydtaVPBzZatAEjUDDEJmAMLVFs45qfyh MiNapHJo2n3MW/E5omqCvEkDdWX/en3P7CK2TemeaDghMsgkNKax/z0wNo5UZCkOPOz0xpNi UilOVbkuezZZNg65741qee2lfXhQIaZ66yT7hphc/N/z3PIAtLeze4u1VR2EXAuZ2sWAdlKC NTlJMsaU/x70BV11Wd/ypnVzM68dfdQIIAj1iMFAD/lXGlEUmKXg5Ov2VQDlTntQoanCYrAg +8CttPzjrydgLZFq3hrtQmfc0se5yv1WHS69+BsUOG09RvvawUDZxUjW19kyeN9THaNRgow3 kSuArUp6zSmJABEBAAHCwF8EGAEIAAkFAlMQe0ECGwwACgkQGuaGDlbL0pMN5wgA4bCkX/qw EVC06ToeR6C2putmSWQMgpDaqrv65Hubo+QGmg2P4ewTYQQ4g6oYWS03qHxqVVWhKz7FjfrV +dH8qbCLfSgIcvdBha7ayGZVrsiuMLKGbw36fcmkZPpSDOfHcP0XH8Z+u9CWj0xUkTxAlZ/7 i6gYSUpG2JWNtdmE/X8VVEyXusCLwy0K0BI60A/4dRTIX3C4QKrJ3ZbUXegz70ynjHf+lQMZ 9IZKASoRMuS5FozPQh6abvmwZEPdf5I9riUElzvHrqJ8Bx0t3Pujdoth+yNHpnBxrtO8LkQd rQ58P0SwcaIX33T2U9pG8bhu5YVR88FQ8OQ0cEsPBpDncg== In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Spamd-Bar: - X-Spamd-Result: default: False [-2.00 / 15.00]; MISSING_MIME_VERSION(2.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; DMARC_POLICY_ALLOW(-0.50)[madpilot.net,quarantine]; R_DKIM_ALLOW(-0.20)[madpilot.net:s=bjowvop61wgh]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.10)[text/plain]; ASN(0.00)[asn:24940, ipnet:159.69.0.0/16, country:DE]; TO_DN_EQ_ADDR_SOME(0.00)[]; MISSING_XM_UA(0.00)[]; TO_DN_SOME(0.00)[]; MIME_TRACE(0.00)[0:+]; ARC_NA(0.00)[]; DKIM_TRACE(0.00)[madpilot.net:+]; MID_RHS_MATCH_FROM(0.00)[]; MLMMJ_DEST(0.00)[emulation@freebsd.org,freebsd-arm@freebsd.org,freebsd-pkg@freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_FIVE(0.00)[5]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_LAST(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; SUBJECT_HAS_QUESTION(0.00)[] X-Rspamd-Queue-Id: 4TNt474vNhz4jDp List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org On 29/01/24 09:26, Guido Falsi wrote: > On 29/01/24 02:10, Warner Losh wrote: >> >> >> On Sun, Jan 28, 2024 at 4:45 PM Nathan Reilly-list > > wrote: >> >> >> >>>     On 29 Jan 2024, at 8:43 am, Guido Falsi >>     > wrote: >>>     On 28/01/24 22:34, Guido Falsi wrote: >>>>     On 28/01/24 22:23, Warner Losh wrote: >>>>>     On Sun, Jan 28, 2024, 12:38 PM Guido Falsi >>>>     >>>>     >> wrote: >>>>> >>>>>         On 28/01/24 15:15, Guido Falsi wrote: >>>>>         [snip] >>>>>          > Creating repository in /tmp/packages:   0% >>>>>          > >>>>> >>>>>         BTW, forgot to mention last time this worked without issue >>>>>     was around >>>>>         20th December. >>>>> >>>>> >>>>>     I think this is a bsd-user issue. There is a race somewhere in >>>>>     that code that causes the hangs. I'd love a reproducible test >>>>>     case that is somewhat smaller than python... there are bigger >>>>>     races with the newer stuff and I've not had the time to chase it >>>>>     there either. 😞 >>>>     First of all thanks for your feedback. It encourages me having >>>>     someone else with better knowledge about this confirm that a race >>>>     condition is actually a possible cause! >>>>     Strange this has not been happening up to mid December. >>>>     My main and fully reproducible use case is actually mostly with >>>> pkg. >>>>     at the end of the run poudriere runs `pkg repo` to create the >>>>     meta files and sign the repo. It forks itself (ncpus + 2 I guess, >>>>     even forcing it to 1 worker I see three processes), and then >>>>     locks up, with all the processes stopping using CPU (ps output is >>>>     in my message) >>>>     I guess this can be reproduced with any poudriere repo with at >>>>     least more than ncpus packages in it. can also be reproduced >>>>     using `poudriere pkgclean -u ` >>>>     If that does not work I'm not sure how to reproduce it in other >>>>     ways, but I can try  writing some code mocking what pkg seems to >>>>     be doing, not an expert at such things, though. >>> >>>     In case it helps further norrow doen things, It looks like the >>>     lockup is happening somewhere around here: >>> >>> >>> https://github.com/freebsd/pkg/blob/56fa3f87d9d9644348b89680dfd8af47a860ee82/libpkg/pkg_repo_create.c#L778 >>> >>>     and/or in the pkg_create_repo_worker() function here: >>> >>> >>> https://github.com/freebsd/pkg/blob/56fa3f87d9d9644348b89680dfd8af47a860ee82/libpkg/pkg_repo_create.c#L341 >>> >>> >>>     (I'm trying to spare you the time needed to find the actual code >>>     being executed, I guess you would have identified this in a few >>>     minutes yourself, but I'm trying to make myself useful) >> >> >>     There appears to be a GitHub issue for poudriere with this, but >>     seems to be looking in another direction. >> >>     https://github.com/freebsd/poudriere/issues/1009 >>     >> > > This one looks quite similar. > > In my case the ports/pkg are aligned between host and jail, in fact I > have built them from the exact same git checkout. > > I noticed pkg head has been converted to using pthreads instead of fork, > maybe that could help. I will make time to perform some testing. Thanks for pointing me here, it looks like this was "it", in that by fixing this issue it uses native pkg-static, and sidesteps the issue. Unluckily there ARE qemu races and lockups that prevent arm64 pkg-static binary to be correctly emulated by qemu-user-static. such conditions also cause sporadic failures in some ports being built. I filed a PR with a fix for that issue: https://github.com/freebsd/poudriere/pull/1115 -- Guido Falsi From nobody Mon Jan 29 15:53:54 2024 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TNtC50JNcz58wrQ for ; Mon, 29 Jan 2024 15:54:09 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-lf1-x130.google.com (mail-lf1-x130.google.com [IPv6:2a00:1450:4864:20::130]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4TNtC41WSbz4kFn for ; Mon, 29 Jan 2024 15:54:08 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-lf1-x130.google.com with SMTP id 2adb3069b0e04-51032e62171so2477948e87.3 for ; Mon, 29 Jan 2024 07:54:08 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20230601.gappssmtp.com; s=20230601; t=1706543646; x=1707148446; darn=freebsd.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=cgy2daOrsxJC1nya0nGFzmIpH3kAc4FKzE49H4TN5L4=; b=teBLXGau8bpHnf+D0VBPDYyl4PEiFPRzzcBLUNYtftWo1vQJ8aoslaSEJHm5b1vGM4 K2j0M7lRsVCVjTEj6kDtsW37NhXcdJCpC6LpvOxfeQx+cnnzyplm76Q64zCQDD3adI2C fOuGWtpcN7/5T+yygbVPVVZXLjm6DxvbxL/nkAAz+h/L+ltozCkWWh01OixfkIz2KQ+A 1ejfmksulBc7/pXEBCUsIVN0b/GZPetJDkS21v2BgEOFBOqVFvBlNSWHgofgtvzYBBUt DGxLAP1DIuYF0MudJxURd8NcdrcQ5BtRJy0si2ESUv/msBGuLmQqXKYOSV4FzucyFAt3 OBTQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1706543646; x=1707148446; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=cgy2daOrsxJC1nya0nGFzmIpH3kAc4FKzE49H4TN5L4=; b=Ca7lVZ6t6tnj/0F6oTyTC8YNjxjjeORsW6CbYQPWuJAhO7Rv6CvEe6YvcDyC/tg1IH h62cwyLvgblfnojeefgHdT4rPMDDb4VugTtsGResMQXq+Ap7GxBFygdPg6uzDiupkgdL 3CJ9zuD9X7vZcj1ArA/jESXxvbY2kX8xChThPqEhRHT05+iX+A27nCkpadPB5uWZDK2G 84rcS7SQ4pddSsSQ7hUDZkjtj824DgOgo9U1UApeN+QT2BRt/M9E89ZB8GAyIY9e7Pwx nOhsgtvpmZQXO6I4bAxMB7TH04CLUBWotuwATeKZs2oGMji7GPX4ajZ36tj4bPNEIllr 9vpw== X-Gm-Message-State: AOJu0YxPbPOvGNsYjKYfj+wHT8mK2UhMUjF22eEepKh/DoGBvPdjEQ1m cGqpx0MuzKbhXbjTHNu5qibowceR49T14VhS8YM8fPPQOjY9+lC3uREuKmvFQGLF3WJPznOnEa7 tmL/OcYhOA+OvWHkk6Rf3hIMmBD0JviwnzmpqkA== X-Google-Smtp-Source: AGHT+IHPSB8BNFNYJyhbhkJA6dXtNMaykIiwsTDPqDl4BOQMLhKj/DEZnIZ5jM7ppMd6V5zboA5TVDRB6QdZbm6LPqc= X-Received: by 2002:a2e:855a:0:b0:2cd:936d:1009 with SMTP id u26-20020a2e855a000000b002cd936d1009mr3969138ljj.19.1706543645807; Mon, 29 Jan 2024 07:54:05 -0800 (PST) List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 References: <6a33726b-eb6f-418e-9fbd-6d0b9b4bfaa8@madpilot.net> <0fc7f929-6e5b-4a33-97d2-8a9c0c07d524@madpilot.net> <79a5eb0f-d04e-4c1a-9d8a-185e1fb4e4a2@madpilot.net> <5ef2ab66-25ef-45f1-aa5a-4b614eab2f40@madpilot.net> <990427ae-0491-463e-92c7-c74700deb6fa@madpilot.net> In-Reply-To: <990427ae-0491-463e-92c7-c74700deb6fa@madpilot.net> From: Warner Losh Date: Mon, 29 Jan 2024 08:53:54 -0700 Message-ID: Subject: Re: qemu-user-static aarch64 lockup/race? (was Re: Python failure in poudriere on arm64 (via qemu-user-static cross compiling)) To: Guido Falsi Cc: Nathan Reilly-list , emulation@freebsd.org, "freebsd-arm@freebsd.org" , freebsd-pkg@freebsd.org Content-Type: multipart/alternative; boundary="000000000000cd7156061017a743" X-Rspamd-Queue-Id: 4TNtC41WSbz4kFn X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] --000000000000cd7156061017a743 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Mon, Jan 29, 2024, 8:48=E2=80=AFAM Guido Falsi wrote: > On 29/01/24 09:26, Guido Falsi wrote: > > On 29/01/24 02:10, Warner Losh wrote: > >> > >> > >> On Sun, Jan 28, 2024 at 4:45=E2=80=AFPM Nathan Reilly-list >> > wrote: > >> > >> > >> > >>> On 29 Jan 2024, at 8:43=E2=80=AFam, Guido Falsi >>> > wrote: > >>> On 28/01/24 22:34, Guido Falsi wrote: > >>>> On 28/01/24 22:23, Warner Losh wrote: > >>>>> On Sun, Jan 28, 2024, 12:38=E2=80=AFPM Guido Falsi >>>>> >>>>> >> wrote: > >>>>> > >>>>> On 28/01/24 15:15, Guido Falsi wrote: > >>>>> [snip] > >>>>> > Creating repository in /tmp/packages: 0% > >>>>> > > >>>>> > >>>>> BTW, forgot to mention last time this worked without issue > >>>>> was around > >>>>> 20th December. > >>>>> > >>>>> > >>>>> I think this is a bsd-user issue. There is a race somewhere in > >>>>> that code that causes the hangs. I'd love a reproducible test > >>>>> case that is somewhat smaller than python... there are bigger > >>>>> races with the newer stuff and I've not had the time to chase i= t > >>>>> there either. =F0=9F=98=9E > >>>> First of all thanks for your feedback. It encourages me having > >>>> someone else with better knowledge about this confirm that a rac= e > >>>> condition is actually a possible cause! > >>>> Strange this has not been happening up to mid December. > >>>> My main and fully reproducible use case is actually mostly with > >>>> pkg. > >>>> at the end of the run poudriere runs `pkg repo` to create the > >>>> meta files and sign the repo. It forks itself (ncpus + 2 I guess= , > >>>> even forcing it to 1 worker I see three processes), and then > >>>> locks up, with all the processes stopping using CPU (ps output i= s > >>>> in my message) > >>>> I guess this can be reproduced with any poudriere repo with at > >>>> least more than ncpus packages in it. can also be reproduced > >>>> using `poudriere pkgclean -u ` > >>>> If that does not work I'm not sure how to reproduce it in other > >>>> ways, but I can try writing some code mocking what pkg seems to > >>>> be doing, not an expert at such things, though. > >>> > >>> In case it helps further norrow doen things, It looks like the > >>> lockup is happening somewhere around here: > >>> > >>> > >>> > https://github.com/freebsd/pkg/blob/56fa3f87d9d9644348b89680dfd8af47a860e= e82/libpkg/pkg_repo_create.c#L778 > < > https://github.com/freebsd/pkg/blob/56fa3f87d9d9644348b89680dfd8af47a860e= e82/libpkg/pkg_repo_create.c#L778 > > > >>> > >>> and/or in the pkg_create_repo_worker() function here: > >>> > >>> > >>> > https://github.com/freebsd/pkg/blob/56fa3f87d9d9644348b89680dfd8af47a860e= e82/libpkg/pkg_repo_create.c#L341 > < > https://github.com/freebsd/pkg/blob/56fa3f87d9d9644348b89680dfd8af47a860e= e82/libpkg/pkg_repo_create.c#L341 > > > >>> > >>> > >>> (I'm trying to spare you the time needed to find the actual code > >>> being executed, I guess you would have identified this in a few > >>> minutes yourself, but I'm trying to make myself useful) > >> > >> > >> There appears to be a GitHub issue for poudriere with this, but > >> seems to be looking in another direction. > >> > >> https://github.com/freebsd/poudriere/issues/1009 > >> > >> > > > > This one looks quite similar. > > > > In my case the ports/pkg are aligned between host and jail, in fact I > > have built them from the exact same git checkout. > > > > I noticed pkg head has been converted to using pthreads instead of fork= , > > maybe that could help. I will make time to perform some testing. > > Thanks for pointing me here, it looks like this was "it", in that by > fixing this issue it uses native pkg-static, and sidesteps the issue. > > > Unluckily there ARE qemu races and lockups that prevent arm64 pkg-static > binary to be correctly emulated by qemu-user-static. such conditions > also cause sporadic failures in some ports being built. > > I filed a PR with a fix for that issue: > > https://github.com/freebsd/poudriere/pull/1115 Ok. This dodges the problem. But it papers over things. Any chance you could give me the state of pkg before + the package added as a test case for qemu? Warner > > -- > Guido Falsi > > --000000000000cd7156061017a743 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


On Mon, Jan 29, 2024, 8:48=E2=80=AFAM Guido Falsi <= mad@madpilot.net> wrote:
On 29/01/24 09:26, Guido Falsi wrote:
> On 29/01/24 02:10, Warner Losh wrote:
>>
>>
>> On Sun, Jan 28, 2024 at 4:45=E2=80=AFPM Nathan Reilly-list <list= s@nreilly.com
>> <mailto:lists@nreilly.com>> wrote:
>>
>>
>>
>>> =C2=A0=C2=A0=C2=A0 On 29 Jan 2024, at 8:43=E2=80=AFam, Guido F= alsi <mad@madpilot.net
>>> =C2=A0=C2=A0=C2=A0 <mailto:mad@madpilot.net>> wrote= :
>>> =C2=A0=C2=A0=C2=A0 On 28/01/24 22:34, Guido Falsi wrote:
>>>> =C2=A0=C2=A0=C2=A0 On 28/01/24 22:23, Warner Losh wrote: >>>>> =C2=A0=C2=A0=C2=A0 On Sun, Jan 28, 2024, 12:38=E2=80= =AFPM Guido Falsi <mad@madpilot.net
>>>>> =C2=A0=C2=A0=C2=A0 <mailto:mad@madpilot.net> &= lt;mailto:mad@madpilot.net
>>>>> =C2=A0=C2=A0=C2=A0 <mailto:mad@madpilot.net>&g= t;> wrote:
>>>>>
>>>>> =C2=A0=C2=A0=C2=A0 =C2=A0=C2=A0=C2=A0 On 28/01/24 15:1= 5, Guido Falsi wrote:
>>>>> =C2=A0=C2=A0=C2=A0 =C2=A0 =C2=A0 [snip]
>>>>> =C2=A0=C2=A0=C2=A0 =C2=A0=C2=A0=C2=A0=C2=A0 > Creat= ing repository in /tmp/packages:=C2=A0=C2=A0 0%
>>>>> =C2=A0=C2=A0=C2=A0 =C2=A0=C2=A0=C2=A0=C2=A0 >
>>>>>
>>>>> =C2=A0=C2=A0=C2=A0 =C2=A0=C2=A0=C2=A0 BTW, forgot to m= ention last time this worked without issue
>>>>> =C2=A0=C2=A0=C2=A0 was around
>>>>> =C2=A0=C2=A0=C2=A0 =C2=A0=C2=A0=C2=A0 20th December. >>>>>
>>>>>
>>>>> =C2=A0=C2=A0=C2=A0 I think this is a bsd-user issue. T= here is a race somewhere in
>>>>> =C2=A0=C2=A0=C2=A0 that code that causes the hangs. I&= #39;d love a reproducible test
>>>>> =C2=A0=C2=A0=C2=A0 case that is somewhat smaller than = python... there are bigger
>>>>> =C2=A0=C2=A0=C2=A0 races with the newer stuff and I= 9;ve not had the time to chase it
>>>>> =C2=A0=C2=A0=C2=A0 there either. =F0=9F=98=9E
>>>> =C2=A0=C2=A0=C2=A0 First of all thanks for your feedback. = It encourages me having
>>>> =C2=A0=C2=A0=C2=A0 someone else with better knowledge abou= t this confirm that a race
>>>> =C2=A0=C2=A0=C2=A0 condition is actually a possible cause!=
>>>> =C2=A0=C2=A0=C2=A0 Strange this has not been happening up = to mid December.
>>>> =C2=A0=C2=A0=C2=A0 My main and fully reproducible use case= is actually mostly with
>>>> pkg.
>>>> =C2=A0=C2=A0=C2=A0 at the end of the run poudriere runs `p= kg repo` to create the
>>>> =C2=A0=C2=A0=C2=A0 meta files and sign the repo. It forks = itself (ncpus + 2 I guess,
>>>> =C2=A0=C2=A0=C2=A0 even forcing it to 1 worker I see three= processes), and then
>>>> =C2=A0=C2=A0=C2=A0 locks up, with all the processes stoppi= ng using CPU (ps output is
>>>> =C2=A0=C2=A0=C2=A0 in my message)
>>>> =C2=A0=C2=A0=C2=A0 I guess this can be reproduced with any= poudriere repo with at
>>>> =C2=A0=C2=A0=C2=A0 least more than ncpus packages in it. c= an also be reproduced
>>>> =C2=A0=C2=A0=C2=A0 using `poudriere pkgclean -u <etc>= ;`
>>>> =C2=A0=C2=A0=C2=A0 If that does not work I'm not sure = how to reproduce it in other
>>>> =C2=A0=C2=A0=C2=A0 ways, but I can try=C2=A0 writing some = code mocking what pkg seems to
>>>> =C2=A0=C2=A0=C2=A0 be doing, not an expert at such things,= though.
>>>
>>> =C2=A0=C2=A0=C2=A0 In case it helps further norrow doen things= , It looks like the
>>> =C2=A0=C2=A0=C2=A0 lockup is happening somewhere around here:<= br> >>>
>>>=C2=A0 =C2=A0 =C2=A0
>>> https://github.com/freebsd/pkg/blob/56fa3f87d= 9d9644348b89680dfd8af47a860ee82/libpkg/pkg_repo_create.c#L778 <https://github.com/freebsd/pkg/blob/56fa3f87d9d9644348b89680dfd= 8af47a860ee82/libpkg/pkg_repo_create.c#L778>
>>>
>>> =C2=A0=C2=A0=C2=A0 and/or in the pkg_create_repo_worker() func= tion here:
>>>
>>>=C2=A0 =C2=A0 =C2=A0
>>> https://github.com/freebsd/pkg/blob/56fa3f87d= 9d9644348b89680dfd8af47a860ee82/libpkg/pkg_repo_create.c#L341 <https://github.com/freebsd/pkg/blob/56fa3f87d9d9644348b89680dfd= 8af47a860ee82/libpkg/pkg_repo_create.c#L341>
>>>
>>>
>>> =C2=A0=C2=A0=C2=A0 (I'm trying to spare you the time neede= d to find the actual code
>>> =C2=A0=C2=A0=C2=A0 being executed, I guess you would have iden= tified this in a few
>>> =C2=A0=C2=A0=C2=A0 minutes yourself, but I'm trying to mak= e myself useful)
>>
>>
>> =C2=A0=C2=A0=C2=A0 There appears to be a GitHub issue for poudrier= e=C2=A0with this, but
>> =C2=A0=C2=A0=C2=A0 seems to be looking in another direction.
>>
>> =C2=A0=C2=A0=C2=A0 https://githu= b.com/freebsd/poudriere/issues/1009
>> =C2=A0=C2=A0=C2=A0 <https://g= ithub.com/freebsd/poudriere/issues/1009>
>>
>
> This one looks quite similar.
>
> In my case the ports/pkg are aligned between host and jail, in fact I =
> have built them from the exact same git checkout.
>
> I noticed pkg head has been converted to using pthreads instead of for= k,
> maybe that could help. I will make time to perform some testing.

Thanks for pointing me here, it looks like this was "it", in that= by
fixing this issue it uses native pkg-static, and sidesteps the issue.


Unluckily there ARE qemu races and lockups that prevent arm64 pkg-static binary to be correctly emulated by qemu-user-static. such conditions
also cause sporadic failures in some ports being built.

I filed a PR with a fix for that issue:

https://github.com/freebsd/poudriere/pull/1= 115

Ok. This dodges the problem. But it papers over things.

Any chance you could give me the state o= f pkg before + the package added as a test case for qemu?

Warner

<= div dir=3D"auto">
=

--
Guido Falsi <mad@madpilot.net>

--000000000000cd7156061017a743-- From nobody Mon Jan 29 16:02:36 2024 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TNtP15vWYz58xpc; Mon, 29 Jan 2024 16:02:45 +0000 (UTC) (envelope-from mad@madpilot.net) Received: from mail.madpilot.net (vogon.madpilot.net [159.69.1.99]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4TNtP14PvFz4m60; Mon, 29 Jan 2024 16:02:45 +0000 (UTC) (envelope-from mad@madpilot.net) Authentication-Results: mx1.freebsd.org; none Received: from mail (mail [IPv6:fd5c:5351:d272::3]) by mail.madpilot.net (Postfix) with ESMTP id 4TNtNv521gz6dPZ; Mon, 29 Jan 2024 17:02:39 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=madpilot.net; h= content-transfer-encoding:content-type:content-type:in-reply-to :from:from:references:content-language:subject:subject:date:date :message-id:received; s=bjowvop61wgh; t=1706544157; x= 1708358558; bh=LAcRqEj5uYV1Yn4tNfN3RryBSlrFsTskSWksyv4mxdY=; b=M 1/TJn8MVNEQSaygi5t1Xq1BtRg/P5Gk+wP02+9n6w0M9bi/07BKIX675QPo8bn7v N6A1zPdQEsIOtgYYwLelrB6KvYuxEFQeJpJTY6geOLtn+qz7IEQD/PNvhJnFNpr9 KyDJyNSGk+RkhepWnW5o36vNmfLy+MClXFI83M1mmAqjNA3z6yz/k+oGqGqh6JR8 L8E/qsawjXQJFrwiJgDVODYqxb/x9s5KT4W+wQSKvNxOzLm2DeYqkdZ3tBzeMdSk WFt/TMe7quJBgdoVsWWhgeNJC1kgzCiZn9xYs763quOMPrYlexwZYMtCn4QFE0wD Oc84uPvW36S01HMh3x6GA== Received: from mail.madpilot.net ([IPv6:fd5c:5351:d272::3]) by mail (mail.madpilot.net [IPv6:fd5c:5351:d272::3]) (amavisd-new, port 10026) with ESMTP id 8uxFb8pTTZtb; Mon, 29 Jan 2024 17:02:37 +0100 (CET) Message-ID: <8fc35459-c85e-417c-8b6c-de08cf9907a9@madpilot.net> Date: Mon, 29 Jan 2024 17:02:36 +0100 Subject: Re: qemu-user-static aarch64 lockup/race? (was Re: Python failure in poudriere on arm64 (via qemu-user-static cross compiling)) Content-Language: en-US, it To: Warner Losh Cc: Nathan Reilly-list , emulation@freebsd.org, "freebsd-arm@freebsd.org" , freebsd-pkg@freebsd.org References: <6a33726b-eb6f-418e-9fbd-6d0b9b4bfaa8@madpilot.net> <0fc7f929-6e5b-4a33-97d2-8a9c0c07d524@madpilot.net> <79a5eb0f-d04e-4c1a-9d8a-185e1fb4e4a2@madpilot.net> <5ef2ab66-25ef-45f1-aa5a-4b614eab2f40@madpilot.net> <990427ae-0491-463e-92c7-c74700deb6fa@madpilot.net> From: Guido Falsi Autocrypt: addr=mad@madpilot.net; keydata= xsBNBE+G+l0BCADi/WBQ0aRJfnE7LBPsM0G3m/m3Yx7OPu4iYFvS84xawmRHtCNjWIntsxuX fptkmEo3Rsw816WUrek8dxoUAYdHd+EcpBcnnDzfDH5LW/TZ4gbrFezrHPdRp7wdxi23GN80 qPwHEwXuF0X4Wy5V0OO8B6VT/nA0ADYnBDhXS52HGIJ/GCUjgqJn+phDTdCFLvrSFdmgx4Wl c0W5Z1p5cmDF9l8L/hc959AeyNf7I9dXnjekGM9gVv7UDUYzCifR3U8T0fnfdMmS8NeI9NC+ wuREpRO4lKOkTnj9TtQJRiptlhcHQiAlG1cFqs7EQo57Tqq6cxD1FycZJLuC32bGbgalABEB AAHNHkd1aWRvIEZhbHNpIDxtYWRAbWFkcGlsb3QubmV0PsLAeQQTAQgAIwIbAwIeAQIXgAUL CQgHAwUVCgkICwQWAgMBBQJS79AgAhkBAAoJEBrmhg5Wy9KTc0kH/RO64ORBlTbTHaUaOj8F Je5O5NU2Pt9Cyt5ZWBRvxntr1zPTJGKRPS9ihlIfqT4ZvEngQGp57EUyFbCpI0UWasTerImM tt5WACnGmCzUTB39UXx8Oy4b1EgWeTJQ747e/F1mQLXTNa6ijRBE9fYlTb4gAkPN88/wVV9v 3PZozKLTg16ghBzHM/P7Lk8L7clPEZChX1FTa/6eSt3nvzfCuTMZbBPJF/ph+q1KyPqRgVfh tyhu5dvgMoPz/ni41IfeSrkJTD5RXzdyGR9q4Z1NYeBsLkRjC4LxKAP5KqUsvlOUjKvO1byj ApYdMarol+IGkaSk9e3zVYAJkWKjn/ni8XbOwU0EUxB7QQEQAKFhrDceoPdK/IHDSmoj6SQY isvM7VdhcleS7E9DoEAVt7yMbf6HbbMVTTY6ckvwTWQssywLBXNVqxgc4WLJjzfUhgef+WE7 5M3+WFYlOVQLGZY/zEVgma1raYnOHNAOzeHLDmEXjbZP6vGAeDyBbGfQPpE7qGYZ7ubeT3Xw QO+PklcCrvOPj2ZPcAxGNS2xVU/LzONqCrJqLMJSIcCdsbiSP4G5PnDFHtMokaTY6OEr8OEQ fOAerhcHUa/z7Uu8YtmaqKH+QGkE/WEgaRqSiTnv0JOTD+DxehaqvoKPPZ++2NpCZMHB2i6A /xifmQwEiIjEXtcueBRzkNUQkxhqZyS13SrhocL9ydtaVPBzZatAEjUDDEJmAMLVFs45qfyh MiNapHJo2n3MW/E5omqCvEkDdWX/en3P7CK2TemeaDghMsgkNKax/z0wNo5UZCkOPOz0xpNi UilOVbkuezZZNg65741qee2lfXhQIaZ66yT7hphc/N/z3PIAtLeze4u1VR2EXAuZ2sWAdlKC NTlJMsaU/x70BV11Wd/ypnVzM68dfdQIIAj1iMFAD/lXGlEUmKXg5Ov2VQDlTntQoanCYrAg +8CttPzjrydgLZFq3hrtQmfc0se5yv1WHS69+BsUOG09RvvawUDZxUjW19kyeN9THaNRgow3 kSuArUp6zSmJABEBAAHCwF8EGAEIAAkFAlMQe0ECGwwACgkQGuaGDlbL0pMN5wgA4bCkX/qw EVC06ToeR6C2putmSWQMgpDaqrv65Hubo+QGmg2P4ewTYQQ4g6oYWS03qHxqVVWhKz7FjfrV +dH8qbCLfSgIcvdBha7ayGZVrsiuMLKGbw36fcmkZPpSDOfHcP0XH8Z+u9CWj0xUkTxAlZ/7 i6gYSUpG2JWNtdmE/X8VVEyXusCLwy0K0BI60A/4dRTIX3C4QKrJ3ZbUXegz70ynjHf+lQMZ 9IZKASoRMuS5FozPQh6abvmwZEPdf5I9riUElzvHrqJ8Bx0t3Pujdoth+yNHpnBxrtO8LkQd rQ58P0SwcaIX33T2U9pG8bhu5YVR88FQ8OQ0cEsPBpDncg== In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 4TNtP14PvFz4m60 X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:24940, ipnet:159.69.0.0/16, country:DE] List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org On 29/01/24 16:53, Warner Losh wrote: > > > On Mon, Jan 29, 2024, 8:48 AM Guido Falsi > wrote: > > On 29/01/24 09:26, Guido Falsi wrote: > > On 29/01/24 02:10, Warner Losh wrote: > >> > >> > >> On Sun, Jan 28, 2024 at 4:45 PM Nathan Reilly-list > > >> >> wrote: > >> > >> > >> > >>>     On 29 Jan 2024, at 8:43 am, Guido Falsi > >>>     >> wrote: > >>>     On 28/01/24 22:34, Guido Falsi wrote: > >>>>     On 28/01/24 22:23, Warner Losh wrote: > >>>>>     On Sun, Jan 28, 2024, 12:38 PM Guido Falsi > > >>>>>     > > > >>>>>     >>> wrote: > >>>>> > >>>>>         On 28/01/24 15:15, Guido Falsi wrote: > >>>>>         [snip] > >>>>>          > Creating repository in /tmp/packages:   0% > >>>>>          > > >>>>> > >>>>>         BTW, forgot to mention last time this worked without > issue > >>>>>     was around > >>>>>         20th December. > >>>>> > >>>>> > >>>>>     I think this is a bsd-user issue. There is a race > somewhere in > >>>>>     that code that causes the hangs. I'd love a reproducible test > >>>>>     case that is somewhat smaller than python... there are bigger > >>>>>     races with the newer stuff and I've not had the time to > chase it > >>>>>     there either. 😞 > >>>>     First of all thanks for your feedback. It encourages me having > >>>>     someone else with better knowledge about this confirm that > a race > >>>>     condition is actually a possible cause! > >>>>     Strange this has not been happening up to mid December. > >>>>     My main and fully reproducible use case is actually mostly > with > >>>> pkg. > >>>>     at the end of the run poudriere runs `pkg repo` to create the > >>>>     meta files and sign the repo. It forks itself (ncpus + 2 I > guess, > >>>>     even forcing it to 1 worker I see three processes), and then > >>>>     locks up, with all the processes stopping using CPU (ps > output is > >>>>     in my message) > >>>>     I guess this can be reproduced with any poudriere repo with at > >>>>     least more than ncpus packages in it. can also be reproduced > >>>>     using `poudriere pkgclean -u ` > >>>>     If that does not work I'm not sure how to reproduce it in > other > >>>>     ways, but I can try  writing some code mocking what pkg > seems to > >>>>     be doing, not an expert at such things, though. > >>> > >>>     In case it helps further norrow doen things, It looks like the > >>>     lockup is happening somewhere around here: > >>> > >>> > >>> > https://github.com/freebsd/pkg/blob/56fa3f87d9d9644348b89680dfd8af47a860ee82/libpkg/pkg_repo_create.c#L778 > > >>> > >>>     and/or in the pkg_create_repo_worker() function here: > >>> > >>> > >>> > https://github.com/freebsd/pkg/blob/56fa3f87d9d9644348b89680dfd8af47a860ee82/libpkg/pkg_repo_create.c#L341 > > >>> > >>> > >>>     (I'm trying to spare you the time needed to find the actual > code > >>>     being executed, I guess you would have identified this in a few > >>>     minutes yourself, but I'm trying to make myself useful) > >> > >> > >>     There appears to be a GitHub issue for poudriere with this, but > >>     seems to be looking in another direction. > >> > >> https://github.com/freebsd/poudriere/issues/1009 > > >>     > > >> > > > > This one looks quite similar. > > > > In my case the ports/pkg are aligned between host and jail, in > fact I > > have built them from the exact same git checkout. > > > > I noticed pkg head has been converted to using pthreads instead > of fork, > > maybe that could help. I will make time to perform some testing. > > Thanks for pointing me here, it looks like this was "it", in that by > fixing this issue it uses native pkg-static, and sidesteps the issue. > > > Unluckily there ARE qemu races and lockups that prevent arm64 > pkg-static > binary to be correctly emulated by qemu-user-static. such conditions > also cause sporadic failures in some ports being built. > > I filed a PR with a fix for that issue: > > https://github.com/freebsd/poudriere/pull/1115 > > > > Ok. This dodges the problem. But it papers over things. Definitely, but this is actually also what was happening in the past. It stopped using native (host) pkg-static due to the pkg port gaining a PORTREVISION, which caused the same version check to fail. I agree the underlying issue should be fixed. > > Any chance you could give me the state of pkg before + the package added > as a test case for qemu? Not sure I understand what you are asking for, can you elaborate? What I did was run poudriere asking it to compile a few packages, the lockup, when trying to use target arch pkg-static via qemu-user, is reproducible 100% in my experience. It does not really depend on number of packages. I get it by starting with an empty build. I'm building these packages (and obviously their dependencies): dns/unbound net/kea sysutils/tmux (I guess building only tmux could suffice) With poudriere you can get it to use target arch pkg-static by modifying /usr/local/share/poudriere/common.sh function ensure_pkg_installed, making sure the check here fails: https://github.com/freebsd/poudriere/blob/e00503d846dc7a3b661aac84a6657f15e0f4b702/src/share/poudriere/common.sh#L5687 -- Guido Falsi From nobody Tue Jan 30 16:01:50 2024 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TPVKd2st7z595Mj for ; Tue, 30 Jan 2024 16:01:57 +0000 (UTC) (envelope-from void@f-m.fm) Received: from wout2-smtp.messagingengine.com (wout2-smtp.messagingengine.com [64.147.123.25]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4TPVKc2KBbz430H for ; Tue, 30 Jan 2024 16:01:56 +0000 (UTC) (envelope-from void@f-m.fm) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=f-m.fm header.s=fm3 header.b=lnr99o+t; dkim=pass header.d=messagingengine.com header.s=fm3 header.b=mKDgJsSO; dmarc=pass (policy=none) header.from=f-m.fm; spf=pass (mx1.freebsd.org: domain of void@f-m.fm designates 64.147.123.25 as permitted sender) smtp.mailfrom=void@f-m.fm Received: from compute3.internal (compute3.nyi.internal [10.202.2.43]) by mailout.west.internal (Postfix) with ESMTP id 179C33200B1B for ; Tue, 30 Jan 2024 11:01:52 -0500 (EST) Received: from mailfrontend1 ([10.202.2.162]) by compute3.internal (MEProxy); Tue, 30 Jan 2024 11:01:53 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=f-m.fm; h=cc :content-type:content-type:date:date:from:from:in-reply-to :message-id:mime-version:reply-to:subject:subject:to:to; s=fm3; t=1706630512; x=1706716912; bh=c5x3UqW/usOKdOBIkJ5t4I0+Md0UorB/ S6IbJUEV2KU=; b=lnr99o+tWobN5srenK+aYNfg2zlGoQNkpR7GB7JFue7ZbQf9 ITv8B61fQ8KckZVyewvdy/V2lZeZox7F7QOJ90ZM0hzP6AIH4r1LCqZ732eoZqiQ V2Ecm1d7FWPdJUHpbwxgzPOPxU2qe3OzxhP/qp/ukZkuaYxJwf4aQfw7s9gPqW9K IAwO18WkLF88ZE32lw+a6NXJTEUsTdCDCO6vKtZ+Wu2025JGTT0tHclUpURzwkk9 q2SM5kI7ETUfsYMYu7QdVyAz4NzlAbEY1P31o8l/Q007IiRhNrMP/yYAkVuZd3/u H9lz6MYZJZZg4jHmuZH1faIvnt5jS7jjU5CzaA== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:content-type:date:date :feedback-id:feedback-id:from:from:in-reply-to:message-id :mime-version:reply-to:subject:subject:to:to:x-me-proxy :x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm3; t= 1706630512; x=1706716912; bh=c5x3UqW/usOKdOBIkJ5t4I0+Md0UorB/S6I bJUEV2KU=; b=mKDgJsSOQ2iuUjxPXyP3Qixxvu13vAwddxZUZmLTsVwBaRDjaEr R9Es9oV8R/SvCoNfaHSsDubrgmwUbmzZ23sVt//hXu78Onjsw5w4Tddo1bavOW53 +RFUvLUZv8tlZtrx37hOku9GfUr9OXbv29xTAqmQm85cHFY45eUrld60ZEh0qUCW hNEi41AOptcSGIpDtPBRgzCjbvjGzbJDoNusejlSmvNvj1yGIAGYMMMADwkslUv6 q4xQuuGUfBM/K1JcRHle0C9EVexA9zY0MPtCcaGI4szdCfABoK1iQ7noyf6oxX6H bSfp7IX7tFO28fHdmd9tZ7jwQPGaudQxpCw== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvkedrfedtjedgudeiucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpeffhffvuffkgggtugesthdtredttd dtvdenucfhrhhomhepvhhoihguuceovhhoihgusehfqdhmrdhfmheqnecuggftrfgrthht vghrnhepveduffeivdfffffghfegfeejfefftdeiteehteekfefhvdefgfettdeuheegff eunecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrhhomhepvhho ihgusehfqdhmrdhfmh X-ME-Proxy: Feedback-ID: i2541463c:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA for ; Tue, 30 Jan 2024 11:01:51 -0500 (EST) Date: Tue, 30 Jan 2024 16:01:50 +0000 From: void To: freebsd-arm@freebsd.org Subject: arm64 system clang & llvm Message-ID: Mail-Followup-To: freebsd-arm@freebsd.org List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.77 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.77)[-0.771]; MID_RHS_NOT_FQDN(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[f-m.fm,none]; RWL_MAILSPIKE_EXCELLENT(-0.40)[64.147.123.25:from]; R_DKIM_ALLOW(-0.20)[f-m.fm:s=fm3,messagingengine.com:s=fm3]; R_SPF_ALLOW(-0.20)[+ip4:64.147.123.25]; MIME_GOOD(-0.10)[text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[64.147.123.25:from]; FROM_HAS_DN(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; ARC_NA(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_FROM(0.00)[f-m.fm]; MIME_TRACE(0.00)[0:+]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; DKIM_TRACE(0.00)[f-m.fm:+,messagingengine.com:+]; TO_DN_NONE(0.00)[]; MLMMJ_DEST(0.00)[freebsd-arm@freebsd.org]; PREVIOUSLY_DELIVERED(0.00)[freebsd-arm@freebsd.org]; RCVD_VIA_SMTP_AUTH(0.00)[]; MISSING_XM_UA(0.00)[]; ASN(0.00)[asn:29838, ipnet:64.147.123.0/24, country:US]; FREEMAIL_ENVFROM(0.00)[f-m.fm]; DWL_DNSWL_NONE(0.00)[messagingengine.com:dkim] X-Rspamd-Queue-Id: 4TPVKc2KBbz430H context is main-n267804 arm64 I'd like to avoid building base compilers for arches I'll never use. I want aarch64 *only* To achieve this, there's the following in /etc/src.conf ### # LLVM WITHOUT_LLVM_TARGET_ALL= WITH_LLVM_TARGET_AARCH64= WITHOUT_LLVM_TARGET_ARM= WITHOUT_LLVM_ASSERTIONS= But looking at buildworld output, I see what *looks* like building for other arches happening. Is this the case, or am I reading it wrong, or is the src.conf wrong? thanks in advance, -- From nobody Tue Jan 30 17:14:22 2024 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TPWxT3MjHz59CgH for ; Tue, 30 Jan 2024 17:14:37 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic311-24.consmr.mail.gq1.yahoo.com (sonic311-24.consmr.mail.gq1.yahoo.com [98.137.65.205]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4TPWxT0Pplz4Hml for ; Tue, 30 Jan 2024 17:14:36 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1706634874; bh=OGVN2YahYJxc+3Ib/D+Hq8I4ixsRU+xKuF2Y1I5sHOc=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=ksh5vlC70pW6Ufx07uuyGgv3GY9WHTyiL31c7aYLXHdl1bMaQjOcn2+q/Ojk1IfaA6+Pr2RLwTb/Iw8NxhkKayJFX4C3+jpp1a7hfKKYSaR/NOIalSMjF8YhM1v6v2AsDp0ryyW4hz/fMmPBubpm6c2FpP/EWFI89NZW9QhKm7F9gCpfJK99SXg342Y3ZjwaPEvqXnWvKRZJdbCRY13nTBQYWzoG4fWbJc0Q3umwkEnqAw+3IenIIIElQNi0QqTGyVv/R6E6+2V2ttLynslHWt84va/Lbru4V+xsobUrwtPhVJuspbafOln02InHMtzO5JKIxSseJPt4QnXhHkUYUA== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1706634874; bh=bAo/eWYMmCtyhVx0o6l1Ov8qQC7WlMTto4RGftT2IdF=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=I0xIYD5xlOyvxfoA0rgrBI5SmseIC8GyjbfU8/4gXSmCzeBiEost60l3Mcd5dL+HMiUZIYqzAxL3t4SHAWtCBVaTqU78HO6EcORaGdXjQj+R1geR/S4TYd3UcGszrkq0IYjmtRHhqi+pTtEh+0Fz2InKKmAN+mqJyEqrHIo6MjzjqrWD33Ly8bF+12F1gUQ6gADjnA5nMD60gHeFsesOvk46OcBQ9v3pFjweXLrKL5HNfmqkeGoxhJYA9dNmG7amZ5AuNsRi/qQRZAyS7umVmp1vZGJtVoP0zMww4FCFiGhGXXpBIg/25wWcyARq80vD2Nr1+fjKwLwVEWRCaPePUQ== X-YMail-OSG: 26dvwHcVM1nZl3.tPrlKtOV34bPkWH8c8kIqZ3jqVcUAswNU5mjybB2UfDYBSUe srLXsvIGj.0Vrap_271dqi5H3lTXpMo9mptVpPEH11jG0pSIUcJNUvi9iBwgMeyLHV3bhNTr7H8i TewC_F6qA1Cov8rxleTyQw.lhqV5mRrfGfEczpWC8XMy0vJApb6UNMfZzbCZLxCmMDpBDb__aAgp wWgZPOHADelQX3XsbHebiqwudQIe808C2kbk9UxlxOrcJTR.F2yJyMFQnnvuQGQEznk3z8eaMHnU .on6lEZfROckSbadVpP2lWhW3TYIL0ie32fXfaaD1LrAjAZtQi9DJbe_nTI_tadEq1QX2sXB8cgO 7FCkUSw7Dka.hzV_iT4bp74IFeVMNqP6XBnCQqDM0CwrEVGUPTyzJ2M.o2f.2wMNyH6hMd.FOhm9 G3hjXU7GB9YgkOPbDwZ6nDukJEa6DtVISw.PTi84UAMe3oFS4X7e_wTJ0XpfGmugAE0fI4G.qlGT rJk012nhvsfIFF65Kt_VE5ju5liN0fYhjuPjfJNDAZ11HdPpr8.YP_.mDt_JSZWhgIcL8lOv44gm CwUmP7VcledtLx.XsRVaxH5HIoLv47eZBjJkYA4RNtnpnz6C9dwCJVZCpU7A7IGMG0XiBvNPTYol MldIXzqS1sOCKQaLroLZwBPAUOAtSvOTFEDK.lOrdjhWhK7gCH8iZBjKBbwY9Ch7u3dWiZoQjRV8 X1woUeeRj72W0g5tbIGT91uJ7aznifKkmiMj_nHSC_bfGI__hC317euLnW0ZRgNZcDN9f3_ywcYg wH7VJeRHkLkS7.Z8aPZ.1wPkp_oluw_jZHWFS5Ak4w1W5JI3s2SxGNvToiE2b9iqgCwLOoL0qupC QEqiTtizn407X8cKyAr_QXrRtspRZMDlOVaZ6r.3l.TV62nCithRVYjVLNhToj9avZnz4hTt.umX caE1xouMc64vFXnCcoYYn_CglrYDGEvBdi6Em2b93p_K0MyJK.dchmJxa.RgFZuZJm8rNMJ7I2mW i8sS0isBrvfJmrwTn3e7oHxQayDxjqwiFfubcV5.nPuxYAYO.epWeBgzSrkrqX.lscnZKZiiidaa hQnE.5hM7T9GFOnsX9oV7rqdKTik742U0OQKsvDzbZKBWl8hDtOK.efAJmZPIL5MiCdjAmtVDWF_ DVLrkXrANa9yofydUlh.oo578nnxsZ3nR8Gskaggwd23F.zpesuS7ugCmzmHlJmSJ0IpTCOcC77V iPdeGPzj1SVq2AzpF5znOAleJHVnAfYXg8cMBt5sSy3UkD3XWc2EtSDIGiQ_6XOb1Xhd4GCPNF4x LCiaXLkYasOKHa1TS87_WI5KHy0XM_3WBJZyA8ygtx_8lqSEy5a3xiuaQmoCKyDpYc6sza8nV2Ip RLcoPz7EKlwWd6uFUWQJIjJuR5u_xly__P.FoVTsFzduni8dIVRdIgMKE5a1ThdzDE0.L3TrJDaI 5u9LW3BPiMCkZGtvSRsC0JT0NDh.ciusXEaacJawXOTYJiyOSGTLPrdSQOi6PAztvqN6kczb2ZA0 1uC0gJ55.Hc4YtV.MRiH_LQgZ8T5kFVk04y63lhkTUlexoo5nuhPGut1ERL099ogAuY664CqhtSZ 8q5IZj5ZVU44QjM0KHi_QvAXJsHTmL2D21aKPTfYn_XJXIcXdz0kA3bHLk6NxgIGcqsnPp9lAfv1 MzWKZNaI49YtYj7oATJSiBmEShf6X.qgn8mQn_TSk2KZ3tmIy80tNHmvHKaKNXeeKHtSyYBAn25Z DTD8VKvGrC.etxCHswQfcHBBDSUQLIfpuBuOFKzuerT32n34CBhVO_n65Ze0N7BtajuGLSGcscqG bkHQk93w9hGEnCXmi16w9811b4yReXdWd_utXYAs.2qp_Dl0oAHk9ssBvLAxUSCbhHk7naEQWI7M Nl2NI9H1YhMCbVFrVVUcsBB5oJ2NdTQ_HdDJbAkNjMg5NQWNqC7wyBlkw44tlQ7YCTRADR_DGHk_ 4.9MF5UV34SanoeCLWhkhbxzbMT.WInvr.nRZ5_zKYc2ZDsv3xyNguEIgThg9mZLaWPggo0bFuYb SvHC_J_7bDtMMvK_eu4XEH56xAbXYHpUaeimgp71J8ZVJ5McvORCYu0iemVwIPPu38dukRM79L7F Y1rPbqTegvi7.Az2L1Prh5AGwaYJahKdx0gKPgWFOvXZ70BHgAqkyqCiLXV2VK5JzKrZbJHrJgMG JnH2OhyG8LbUHq2Go_nVZ.8erv8PC2iCf_VhCrKB9iraMGmI9PSvCX0v8usXAZuvA0vLUHSdVGSe uYYc- X-Sonic-MF: X-Sonic-ID: 7efa0af3-7e5b-4225-8c9d-e4351edc5533 Received: from sonic.gate.mail.ne1.yahoo.com by sonic311.consmr.mail.gq1.yahoo.com with HTTP; Tue, 30 Jan 2024 17:14:34 +0000 Received: by hermes--production-gq1-5c57879fdf-hrd4s (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 95cec3e853a0318b4ca0a7c2b4df805c; Tue, 30 Jan 2024 17:14:33 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3774.300.61.1.2\)) Subject: Re: arm64 system clang & llvm From: Mark Millard In-Reply-To: Date: Tue, 30 Jan 2024 09:14:22 -0800 Cc: freebsd-arm@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: References: To: void X-Mailer: Apple Mail (2.3774.300.61.1.2) X-Rspamd-Queue-Id: 4TPWxT0Pplz4Hml X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US] On Jan 30, 2024, at 08:01, void wrote: > context is main-n267804 arm64 >=20 > I'd like to avoid building base compilers for arches I'll never use. > I want aarch64 *only* >=20 > To achieve this, there's the following in /etc/src.conf >=20 > ### > # LLVM > WITHOUT_LLVM_TARGET_ALL=3D > WITH_LLVM_TARGET_AARCH64=3D > WITHOUT_LLVM_TARGET_ARM=3D > WITHOUT_LLVM_ASSERTIONS=3D >=20 > But looking at buildworld output, I see what *looks* like building for = other arches happening. Is this the case, or am I reading it wrong, or > is the src.conf wrong? FYI: On aarch64, for non-debug builds I use: #Disables avoiding bootstrap: WITHOUT_LLVM_TARGET_ALL=3D WITH_LLVM_TARGET_AARCH64=3D WITH_LLVM_TARGET_ARM=3D WITHOUT_LLVM_TARGET_MIPS=3D WITHOUT_LLVM_TARGET_POWERPC=3D WITHOUT_LLVM_TARGET_RISCV=3D WITHOUT_LLVM_TARGET_X86=3D MALLOC_PRODUCTION=3D WITH_MALLOC_PRODUCTION=3D WITHOUT_ASSERT_DEBUG=3D WITHOUT_LLVM_ASSERTIONS=3D (I've not validated the comment in a very long time. There used to be the odd side effect on when bootstrap builds happened.) As FreeBSD main [so: 15] has lib32 support by default these days, does your aarch64 hardware support AArch32/armv7 code, at least for EL0? Most of the hardware around probabaly does. Having WITH_LLVM_TARGET_AARCH64=3D may override any attempt to disable code generation for the likely hardware-supported type of code. But, if it is possible to have aarch64 disable armv7 code generation, you would also need: WITHOUT_LIB32=3D Otherwise, you would be asking for armv7 code generation to be done in order to build lib32. (Since AARch32/armv7 also supports armv6, that is likely also involved. But I keep the wording generally simpler.) =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Tue Jan 30 21:02:18 2024 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TPd0G4cXGz57ZpQ for ; Tue, 30 Jan 2024 21:02:22 +0000 (UTC) (envelope-from void@f-m.fm) Received: from out4-smtp.messagingengine.com (out4-smtp.messagingengine.com [66.111.4.28]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4TPd0F4dgrz4mTB for ; Tue, 30 Jan 2024 21:02:21 +0000 (UTC) (envelope-from void@f-m.fm) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=f-m.fm header.s=fm3 header.b=PgIidsF1; dkim=pass header.d=messagingengine.com header.s=fm3 header.b=aYtT7FMJ; dmarc=pass (policy=none) header.from=f-m.fm; spf=pass (mx1.freebsd.org: domain of void@f-m.fm designates 66.111.4.28 as permitted sender) smtp.mailfrom=void@f-m.fm Received: from compute3.internal (compute3.nyi.internal [10.202.2.43]) by mailout.nyi.internal (Postfix) with ESMTP id E5CFB5C00D5 for ; Tue, 30 Jan 2024 16:02:20 -0500 (EST) Received: from mailfrontend2 ([10.202.2.163]) by compute3.internal (MEProxy); Tue, 30 Jan 2024 16:02:20 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=f-m.fm; h=cc :content-type:content-type:date:date:from:from:in-reply-to :in-reply-to:message-id:mime-version:references:reply-to:subject :subject:to:to; s=fm3; t=1706648540; x=1706734940; bh=/KocLG0P1M ESYcP+r/hvCew9T3GDX02v84fDlGax2nI=; b=PgIidsF14fExZmZIP8s/LfK+c+ Eh0dSJ+lHHwaShnb74Qb7cgruj5wqmd4MzWmMpwN8AUdrinoGKZo+xkuEp8ocbXg 2uKSWTMWn+Ij85DTImB4z6INDLk/xWawYY7vdiz2I9K/bsihL2EatMkhrRHOEOrt wVuntcL8JLGve1PGx82n7TXQISUBwXf+UOr1Y9bgddHbg2a9PsLED/xW42SIZbUq ZecjBlZSphA8XoiWSHhkZATa6MfqZ0wBIZDtD9YO3w+6cvaHTPv3YoCi5vNxOYaP 1MdqhtPLFYeW3ahAN+y3OJ8bjmN69MZ/St7qhlSNJ0gOc8KMyiNLvKjxo4rw== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:content-type:date:date :feedback-id:feedback-id:from:from:in-reply-to:in-reply-to :message-id:mime-version:references:reply-to:subject:subject:to :to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s= fm3; t=1706648540; x=1706734940; bh=/KocLG0P1MESYcP+r/hvCew9T3GD X02v84fDlGax2nI=; b=aYtT7FMJovR/lZHdElGWO/YK9bReZyQw1gISMmdYIlQt xCI84KJXapZgNwqaEBekaTyHyk7FPSnIxx6XBfyI8xEH6PVFwOUT/SwnzJQUoOPS DFANhFKft0HlFNdNLJnxTLD65WFbIUkt6+EvlSsZa5sMQAPmnGPMDYA3zBfWivoo qQQSdm4cALe9utX51RcF3p36fLsX5RIj4pUXquThQxngaqCw9CuKWxhiDpp2HGPX UHxWIpkixGe9/0ido7HOs+NkBW9lrd98Iu1uoOIipunSyh4ZuUQlTjvuzNl8qLFF +nmmd/lPdp68IWVF9Vx4V7glcV/S3rlyskQjYdB22Q== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvkedrfedtjedgjeejucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpeffhffvuffkfhggtggujgesthdtre dttddtvdenucfhrhhomhepvhhoihguuceovhhoihgusehfqdhmrdhfmheqnecuggftrfgr thhtvghrnhepkeeluddvlefhieelfefggffhffektdehleelgfdugfdvgeekjeejuddthe ehgfeunecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrhhomhep vhhoihgusehfqdhmrdhfmh X-ME-Proxy: Feedback-ID: i2541463c:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA for ; Tue, 30 Jan 2024 16:02:20 -0500 (EST) Date: Tue, 30 Jan 2024 21:02:18 +0000 From: void To: freebsd-arm@freebsd.org Subject: Re: arm64 system clang & llvm Message-ID: Mail-Followup-To: freebsd-arm@freebsd.org References: List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline In-Reply-To: X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.67 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.97)[-0.972]; DMARC_POLICY_ALLOW(-0.50)[f-m.fm,none]; MID_RHS_NOT_FQDN(0.50)[]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.28]; R_DKIM_ALLOW(-0.20)[f-m.fm:s=fm3,messagingengine.com:s=fm3]; RWL_MAILSPIKE_GOOD(-0.10)[66.111.4.28:from]; RCVD_IN_DNSWL_LOW(-0.10)[66.111.4.28:from]; MIME_GOOD(-0.10)[text/plain]; FREEMAIL_FROM(0.00)[f-m.fm]; RCVD_TLS_LAST(0.00)[]; ARC_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_THREE(0.00)[3]; RCPT_COUNT_ONE(0.00)[1]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; FREEMAIL_ENVFROM(0.00)[f-m.fm]; PREVIOUSLY_DELIVERED(0.00)[freebsd-arm@freebsd.org]; TO_DN_NONE(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; DKIM_TRACE(0.00)[f-m.fm:+,messagingengine.com:+]; MLMMJ_DEST(0.00)[freebsd-arm@freebsd.org]; ASN(0.00)[asn:19151, ipnet:66.111.4.0/24, country:US]; RCVD_VIA_SMTP_AUTH(0.00)[]; MISSING_XM_UA(0.00)[]; DWL_DNSWL_NONE(0.00)[messagingengine.com:dkim] X-Rspamd-Queue-Id: 4TPd0F4dgrz4mTB Hi Mark, On Tue, Jan 30, 2024 at 09:14:22AM -0800, Mark Millard wrote: > >#Disables avoiding bootstrap: WITHOUT_LLVM_TARGET_ALL= this means (if it's uncommented) it doesn't avoid bootstrap? >MALLOC_PRODUCTION= >WITH_MALLOC_PRODUCTION= aren't these the same thing? (for -current context) >WITHOUT_ASSERT_DEBUG= >WITHOUT_LLVM_ASSERTIONS= > > >(I've not validated the comment in a very long time. >There used to be the odd side effect on when bootstrap >builds happened.) > >As FreeBSD main [so: 15] has lib32 support by default >these days, does your aarch64 hardware support >AArch32/armv7 code, at least for EL0? What's EL0? WITHOUT_LIB32= is also in src.conf -- From nobody Wed Jan 31 01:17:06 2024 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TPkfT2Lslz583vv for ; Wed, 31 Jan 2024 01:17:21 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic305-21.consmr.mail.gq1.yahoo.com (sonic305-21.consmr.mail.gq1.yahoo.com [98.137.64.84]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4TPkfS6Tvwz4FXw for ; Wed, 31 Jan 2024 01:17:20 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1706663838; bh=e2V895YtCjLVt6Vyp5ViGqw70ZhQuEy1A/AfcClFu+A=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=V1kNd2LdHa0CQ/wXo0G8I1ilACl61iIBcIL9NxGh/DrrzmC4F4GjT7pfwQ/lgAtQjx6A6vLSd+Y0pLEM5A5Yp+z69usKMP22bC4HsI2YWTPsqwDNL26L2iBuJvilojCz203ms8O06pqrFcW0fpNzrFYP0H9Oq7ZbPmzK5PJuJtN1PuKZ+zBo4wMT6Klq+ps3F4jKpflDtFUgesTegki8UCtsY6+5zC2mVgttZoDxGpD+CG8Pr43Dy+bb6t3Ijftsibwa/4KmISMWJjWEdwfGU1n5uydOunFGp1SGaA/kLIIJf4XBvxg1H2uhViM5KVZxWbQ2D3MTx9hJgS7iJe2mTw== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1706663838; bh=P55MZrZ790MFTjBlhhYmfEHiCBoMa061lfGAn27U1N6=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=OY8VaxRef2oxQ91B87OwchIvus4uwQ4G325FowO1ntlRRw9ihwq1nnDLacD3XrzhYw/TvKpUMHz6ic6mVFrWx5NhD/Y2vi4ThIj8ap5F98x78Tu62P14GD+CTDNgKruUZ6zQDdNcwg4W7q05uuH6yy7ER+7sf21htJ/x1AWGf6x0L079vYqjuAetyhSmAZmStKtMgMOumuay+Bj7YWZOrzP8SmbmWqY5pygAvQdcvjZ5SQGtX2mQszz0m3K1gC4KZ6DNFc/WEMox0FjUkxnIvnR8um2rswjliLT/12q4xamr8kMEx7r260cAG3QuPtcxvA42JJkq4PCTgsj5Nz3QCA== X-YMail-OSG: 2xtLrJQVM1nlZhKBz8Aq8n1TvLG0iRNBPrYvNDQSXmgUZoY7kq7d7prJXsF2t6F C2EUXPis1RAYuL0f15QtiOPcT54NSgOLU_9T04vnsr1IEdtrG8dDetKAu1R5Y3swfDDZNCPyJqGU _hK8Ve5ng07E_c3CPnRukObDd7Tf56TD2MdAyNBsx9dv_.YkrWb36RbJ2ftvgIKmR75HrfJoJK1k YeXB84OLqBcHqE9TQKdU7HsUs5eaiJe_IJf9BvhdQ220ZGyfpuBFOawommspDHiEZgZOnKN6voxZ 0M.KCZQb7KTO9ctO2uqsP.D9SkKZPxGI9a2aeO1fOQwOhaErL1CWGLUESlW4Ao7hwSPwghbbinJd 53JBJaOGRFIP1R2GNencf2kKhS6c51.QxLDDOFfQV.rloNHTwBlwZCJyNRfEICIKEnSuofnTu5GH liGmrOaQiYgKYFjdqml1zihudK5AjcnwUJ8_3GOhE.P5UOIyGvXhcW.R767P84e2_fv16v4mBgLx Ds03xIGtGxvToR6NDEdhsfB8hipEC1v5Kj307o7f2xma2otp3YSyrl8VE2mI_SaRM7iF0LJw761a pc5RS9Giv8XRttWU1FW2gvk12HHEDL0fRjiufgr.F952i1SgIx0KOrJukRKgHRLcVHCtefRJabAM mcjpBgKk.7FzGkv1XC1daBZtDL1iC.pcvvesH9HySkXAN7KeeKXvAHHV5sM3mtzeKrskG1vMO8gL 6sQzoISeIi2qs2Of3Kv5OpXsjpYI7mwWFjfg37dxv8U0v_InG1QGCoFEkly8Cd0X3molVmwm1iam xzsM9AXrkiVKzKmmVH3QAbDQrowKI_UfS1qzvimz2rxjxs2PB3yr_JgVuePmTce6IZ.s6xW4kw1k MRhQ.msQAfEGBxEThK.imB7faLDW7Jtwr2SAvOcXg.EZtXFw5OVTbzrnFQmSaBwHSTpJJfDGY3Vt dHQI.fuF1Rp1NMrNOxJrQtImYM6giSmRUJX4PzV3kw0ulK.vVtnQ01tgrsO.weDrk0YOULdBJBza KJSHNtG7Ooa1lVKcteHt29Nc7FBiIN6zX3eGXPVGZdwjP1fneN6KnIJhpmziChTgLKSt7lmBv38y dmNr4k0pbagbaaPqDkl4MPMB5nNueAxX7f7HSnpWpliaCUvTSF0RIk8vJ_OLA9x11fv9nnHhBY_v _9gJpbLr7VJNkWlxPQ5zUG7eftMSbmAnFbVqTd6siez.Y6rtAo2MSdiV_Bf4vpXsARZ38Lc9riRo 3XDTxOinTXUJ_aWLNIpSPnKVR1rsOXaf0HEE9K3w6JdsAbYkGf6Is4FAA1TD0uCuOKqguHwm08Zd KgRPO0jqKZb6K4rh0O8xDrgTFiyDtCZkNaPBqhYhoHIRmJ1ppRyyAT2YbFMqtkIEC315E8N7CTlu xGxB2D7OogtsZjZRc3oQt4hc49vug9vYtfnobqouzhnK73MenSKW8VugGsY13PAjBTOFYUhjodp8 dWCY2FCHPk5Y_hrRJ56jx3.MRWDxdEbiZkixJFPT8Nwxgy8eczd41e2dNrmILxZ4pimMrkJiwaMN VzwPA3laJS7H20EoHmyrD3TEcZeXey1t8lw1oa_afPPb0xuVZEoMEYIuX7eEjFpA.b73RDbY0x6u Zjd2YXdGnKUneqnR2TBzr3cFfryNs2ldxhmy.0ZiuvRvfr533t4vMVwbqIuYG1SJ1uQFhG.DUybm fG172n8HM80cFXFMUu3jLZwhAz3ZsClqOmmUov6WBFDXUbaDys2qitVHK3odqmWzXtx8qzbJu5l_ XKWtkLQM2DzY3Y9SB2ju_.nIxxMxL7q48kW3AXf1a5oVFXEQ0q3ZAjgxLUNkNSjMno7w3Xma_.GL E7VZnm7GjmWIaU6eA3RU2ASu34o2iP9yFd_18dh5Y7yN94wE6k8rmxM0RnFCV_RVpjAgLnXrWGA7 cgd6nBD1TAVqRxrGANyN78cBljJLKeWI0VHuZ5XG.8sdJis6RDXi14VxKV5bv2b1NiRcoOUNjwvJ 3dg2hjDhSJgQ3SAlHgkNX8YGMFFP7yAOlQWTeJyQtL9DLYKLpWTdLbSoVrq4phAsa1mEo2NNAZeS gghu8IsnP.5o0xjL0zHChPo04EtKIZ_zmnqBluCALdR1QGjbBVyq3nldHvBGHWAy_TWl79iqKqjc YrAHxa.CeFt0xzn_jZSvPhzjvJq4ZVuVbKM.m7Rx2O.LTY3STmPByVznnKuNoVczTC6_jONgETzM Xft_mnXvA0pSu8C.4qCmWVvRXfg4eocmeWW4pSq_G_N7h7L1TccmmaGO2h4tbJh3nyDcz1JWLXxI - X-Sonic-MF: X-Sonic-ID: 3d6a066c-9964-4e1a-9560-196c35b188e6 Received: from sonic.gate.mail.ne1.yahoo.com by sonic305.consmr.mail.gq1.yahoo.com with HTTP; Wed, 31 Jan 2024 01:17:18 +0000 Received: by hermes--production-gq1-5c57879fdf-27p5r (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 01301c4f09d4c25203b81d1a04c15d8a; Wed, 31 Jan 2024 01:17:17 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3774.300.61.1.2\)) Subject: Re: arm64 system clang & llvm From: Mark Millard In-Reply-To: Date: Tue, 30 Jan 2024 17:17:06 -0800 Cc: freebsd-arm@freebsd.org Content-Transfer-Encoding: 7bit Message-Id: <26928272-6565-4AE2-B77A-4449E03634CE@yahoo.com> References: To: void X-Mailer: Apple Mail (2.3774.300.61.1.2) X-Rspamd-Queue-Id: 4TPkfS6Tvwz4FXw X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US] On Jan 30, 2024, at 13:02, void wrote: > Hi Mark, > > On Tue, Jan 30, 2024 at 09:14:22AM -0800, Mark Millard wrote: >> >> #Disables avoiding bootstrap: WITHOUT_LLVM_TARGET_ALL= > > this means (if it's uncommented) it doesn't avoid bootstrap? It used to cause unnecessary bootstrap rebuils during the overall buildworld . >> MALLOC_PRODUCTION= >> WITH_MALLOC_PRODUCTION= > > aren't these the same thing? (for -current context) I frequently have files designed to be allowed in a range of FreeBSD vintages that might not recognize newer (or even older) notations. I change before needing the new notation. I eventually get rid of the older notation. So I happen to have shown both notations. >> WITHOUT_ASSERT_DEBUG= >> WITHOUT_LLVM_ASSERTIONS= >> >> >> (I've not validated the comment in a very long time. >> There used to be the odd side effect on when bootstrap >> builds happened.) >> >> As FreeBSD main [so: 15] has lib32 support by default >> these days, does your aarch64 hardware support >> AArch32/armv7 code, at least for EL0? > > What's EL0? EL: Exception Level. Suggestive are: EL0: Unprivileged execution (user space). In increasing execution privilege order . . . El1: Normal operating system kernel execution. EL2: Non-secure state of execution for Hypervior execution (virtualization) EL3: Allows the security state associated with the execution to be changed between insecure and secure (for secure monitor operation) So hardware with only EL0 for AArch32/armv7 execution can not boot a AArch32/armv7 kernel. But the OS can allow user code to be AArch32/armv7 and run. I'll note that even before lib32 was implemented, a armv7 world could be installed into a directory tree and one could then chroot (or jail) into that directory tree and run AArch32/armv7 user code. Now one does not need to involved a chroot/jail to execution AARch32/armv7 code unless one wants to. > WITHOUT_LIB32= is also in src.conf WITHOUT_LIB32 does not prevent the chroot/jail technique from being used. But it does avoid building any AArch32/armv7 code in the buildworld (which is what you were after). === Mark Millard marklmi at yahoo.com From nobody Wed Jan 31 18:12:03 2024 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TQ99c6zc6z590dr for ; Wed, 31 Jan 2024 18:12:20 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic313-20.consmr.mail.gq1.yahoo.com (sonic313-20.consmr.mail.gq1.yahoo.com [98.137.65.83]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4TQ99c0H6Kz4N0Q for ; Wed, 31 Jan 2024 18:12:19 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=QOv+ZKVJ; dmarc=pass (policy=reject) header.from=yahoo.com; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.65.83 as permitted sender) smtp.mailfrom=marklmi@yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1706724737; bh=iL1Ef8vAI+En6gOuERAwRlO/QhcQFXXLS1EllPWfJRw=; h=From:Subject:Date:To:References:From:Subject:Reply-To; b=QOv+ZKVJpoliuLKza5YublqSYXbB/yfU3hca5Fh/pfNlvBR/7iu+M4GUrjVbgOKkeyheC6nkRWSjCPqH/aYA1BZ+kWCForoDIu5xWpaHm9oQvmnW0tr2Gn3gEjm3X9FIJ1yt/m4yJ3BfNUunWYSlkR/SrAir/i31HrOVlNPNmdVRI6hJ/9C3HVPMmaj5j7jBXfA3nDaEeNfyDAi28wvoF8UwTvs3QZMf831u3d45CqKBzCsKJknwBdANTuYJ8O5JwFgyiK7p6G+ECDKHlYDsPCll4XPWrdlzwVJIm7wnMYokqzHmeLhkRiN61qj0YR6suKJGwweeH/7B0kzrlR/eQw== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1706724737; bh=QH8uwViyGmHs32PBQTWCmMGaq7SdXIVxQItXr3Q0QyC=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=AaBkzHt6cUyhj6cHBpBIddBNIPgwmP/cpeDLuzZIutBBZu28yjtu9D8tjaplxhvOk9F7SRjg/GaSBmqxeYKYBDimkdyIAA1sLCYdd1p45vdBC5pTzsEkLwxjziXuLEDOjiy4DKxdNHENgfWQJ/tjqOYLLs21c/dRofNcBqZ/ULzS12mkGV0v9iJZYFJGA+86PFvHTzwnqTJK1lEXuLiuaQ50tnIPnBl95smYspR2ZuVrwjqqy1aLOsh/E+u8ZR+YedU3Dxb15PJDDBGxWS2z3OaBXWlc0pUFaH2nuRaVr8ofXVKyKz7Ytrl0SJOX3s+bGKscT1l1hkV7m+iu9fBXZg== X-YMail-OSG: a.6c48QVM1mOb04MiZtAhAufvLtufsyL07fn_OnZlc3tMtvyDPF44HIHhTfpemK c4ibUsDlbMyH8Haqpm6pTkKN2RS29YRBf9LDMRk79XtmR1IgYNxZVwUsODri7U.pjPNrh_nKxAtK HFYmP4Kkq_SuP27H6ChwKOfEchtONft6GIHwo8rxBNIZJ7lSX5K2vw7nFI35D3kaxwlEkSHacYrg qjpqfrtRTD4tNFjbUN_N_CsHZJqmMc9iTVEkEzgOo9AHo5kkmwu8nUKbcsKgfSZnvYVJxc0B0szO uvQmuErrV2HsvSflhwCKfj207M5mSrQomuUMZcC.jlM6_N5W76AHIoh7_Y7wVyZ4krfqmiiHT00f fOLjhymynOYribD4oM1thh.SWCoa2KLEZx2nz1azyNsC5AXsLXw325i3rCBbOOJs0HqaXrCpAZR7 6K1tAIzaBNau2Ojc9X8jTkzQQupLytd6uOsltecwlDwU4lOYdTn7r0FkhdvUhSkwbtZ1eQGjLcdY UTIR3ILVtaLMy6NdOAAEYg68HTERGc2rVAg.xngluYp_JTh7onTlxKt_rC.pHYCaDw9gUGpMEHBh EblevaIvNsMMymORuyEZhh5SUO3fyuLfEkz50Jf.cGnKEfmLYLNff0G85WLQhFKyXnNeaSm_SI_z IWkTt_8S0RSwr1XgBStj.b2yXV3URXclNKa45oUhPPxBEkaxXK7nrNAtaivEQ1AtWJLmlsyNJwI. lej1kIK0Wh3C2XCocVxkHxQsT3NZZo7_3HIZvBi4hlRdkU3UAs8HG6dp6dOYm1HZS50FrWGtBdMG PvBhM7m6y2.fTBTCRUcEnD6XbPEjRZ9IzxnGtxqfkFjCc_2TkYet8mxN9lly.OfQv1TcIsVXpmcA vVf2Zd4de.9cA4Hy4QgzUvWTiAbxPIJdni6YHkF.V1oEkDnWbeB.AalcOg4ipK3s9Jwqa0eLaThB UIxgvDwhezt1Ke3p2dRTiR7P5b6RiZ5PGwCPiER8rcajomDP3jxWPwsGTlahUKeFsVc2_YmaqQml Jn5tm4Q8wj8bFlJj7ZP2TVWwzn7WyWkQpNj5DzuhpizGg8NyS1mwja66L2U4npfGJ2B8Sn1Bu.Ss lwQZ5bPdTzzbXfiSmwZ6DY8.eq64TnubZ5bTpfNN8ADYcxP5xh7u7vf6xqJ27qV4SQvHLM3Avu.h ZYUVFAcGji2mgGc7FQdmhjqB23i_.RJyJZrSvMATrleYdhuhcmmn6wH55uL4e.MlNXb_1.ObAmkQ gaD1PovkA2TCDpCnyC4XlFdzM9E26j_AbwRIcoXhbDH0UFOi7UouhQx8KcpOl4gXN5Vy9b9ub6OE hSDH6FfnCYHVL8z8Ead2tFub6JghMXNpnvdl88nffu_6OdKDVafI2_D3NfnVToT4DcoSdToWg3cw qtb8FHDP1A76sHxvjQfCmqCS7k5ZxTBLmpc.1iVOLjdunteMulNKZ32RV7bGUnZsEJ.J8SAH9RTe N8BPCSjgx2K0Vll3yjT8Qtso319qRbP9jdyXyheMbVX1_INCF2op5DcIj7...Pu3Dw3bDCp4xuKg Pdk15hcq5egr.NTyJc.y1sECa1xk88C6Y6VKPXSX_OrPYZcmViLZ9WzmiwrE6KH3rov9ywGV6gIn VdzLrrjF.2CE46dgH4NJDOOhXQqB85th1O_X6zviPc_DuPa8nvRWqZ01VnUTbw3D70BOfmXWOs4. 0ynj.kWUhfwLNAnjGCS_H.N5Btl48diLTWJl9GWwiFkoYtW7y_.deaMqUAevItgOEFy4VaS0uB5. OZibDt8UHvq1Ii7NNGXxKLroWPoRGmTIp8AeKw8XIUCkut41Qp8CAkr.osL4BaCp.ijwQhv4_HW7 sVEH5VLCm4lUtCOZySrRLH0qnZGwIkmGZ9.pV5pbxh0LYNfmRF0p3lPtXKP3o5jNb9Hl6iYVOCLP YfHq1AIYrOQ4SIXBSKOj._QbA1wsANdw28CRjd5G6yZn80PIHj3yAmoe84ZxmVRhz5mMVhQtVQDZ KTBCAae_xprdprjUQUAs9KV3TYjzWv3tavcLh9tYgiFCt77sqKVXB_IS7UUMIaMZl.hMm2zCKLgb i7vKIhrpfh1TR0aBWD8sGIVZrOapbPDj6j.odM3qNOBk5wVEl3iar7AoWxJcpmg_j.HtzbCkbsEj ibtKHbz2SUtiZtPha93ZSmAtQUGQKeD2f0Z9iofa6PxR66sQOchC.ja90FV.FPR91TlyxiVEm5ox 1e6yZPJHSfxtsC4OO9eZkvwSNxRA1.ulRg8mxIayGt1waHgxwAHr_l9s6DA-- X-Sonic-MF: X-Sonic-ID: 66235825-f5ca-4867-b200-b7bbf12e06cc Received: from sonic.gate.mail.ne1.yahoo.com by sonic313.consmr.mail.gq1.yahoo.com with HTTP; Wed, 31 Jan 2024 18:12:17 +0000 Received: by hermes--production-gq1-5c57879fdf-wt62k (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 4df7138ee31076f59a69b985f3d4d2c5; Wed, 31 Jan 2024 18:12:14 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3774.300.61.1.2\)) Subject: RPi5 and EDK2 ( https://github.com/worproject/rpi5-uefi ): USB-is-broken notes Message-Id: Date: Wed, 31 Jan 2024 10:12:03 -0800 To: FreeBSD ARM List X-Mailer: Apple Mail (2.3774.300.61.1.2) References: X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.50 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; URL_IN_SUBJECT(1.00)[github.com]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.998]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; MV_CASE(0.50)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MIME_GOOD(-0.10)[text/plain]; TO_DN_ALL(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; RCPT_COUNT_ONE(0.00)[1]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; MIME_TRACE(0.00)[0:+]; ARC_NA(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; MLMMJ_DEST(0.00)[freebsd-arm@freebsd.org]; RCVD_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.65.83:from]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RCVD_IN_DNSWL_NONE(0.00)[98.137.65.83:from] X-Rspamd-Queue-Id: 4TQ99c0H6Kz4N0Q QUOTE USB is unreliable and may cause data corruption on all supported OSes. = We're currently investigating this issue, see: #3. END QUOTE So what I've reported for FreeBSD is not unique. The best details for now (from that #3): QUOTE of mariobalanica : Yep, I've recently done some testing in Linux and seen corruption there = as well. Unfortunately I haven't been able to consistently reproduce it = across different configurations. There were moments when I could = transfer dozens of gigabytes and it would all be fine - only sometimes = would it actually start corrupting data badly. Here's what I've tried, roughly: =E2=80=A2 Flashed stock RPI OS and checked USB -> OK =E2=80=A2 Modified DTB to expose a single USB controller as = generic-xhci and hide the rest of the RP1 PCIe bus, relying on the VPU = FW PCIe setup (to replicate what UEFI does) -> Corruption =E2=80=A2 Changed the generic-xhci device back to snps,dwc3 with = original quirks, in case the VPU FW didn't take care of that -> = Corruption =E2=80=A2 Reverted all the changes -> OK Then I recompiled the RPi kernel to add ACPI support in and booted RPi = OS via EDK2. Same story: ACPI is bad, FDT is good as long as I don't do = the modifications above. EDK2 itself appears to be unaffected, all transferred data came back = good. The only notable difference (that I'm currently aware of) between = exposing the full RP1 PCIe bus vs. just the XHCI controller as a simple = platform device is interrupts: =E2=80=A2 full RP1 PCIe in Linux with FDT uses MSIs =E2=80=A2 XHCI platform device uses the shared legacy INTA I suspect the RP1 XHCI edge-triggered interrupts don't translate very = well to level ones. This would be bad news for ACPI, since the MSI = controller here is (unsurprisingly) non-standard and we're forced to use = legacy interrupts. This might also explain why EDK2 is not affected, as it uses polling = instead. END QUOTE =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Thu Feb 1 09:30:39 2024 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TQYY134fyz58Fls for ; Thu, 1 Feb 2024 09:30:29 +0000 (UTC) (envelope-from ronald@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4TQYY12M1lz42Mr; Thu, 1 Feb 2024 09:30:29 +0000 (UTC) (envelope-from ronald@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1706779829; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=xRt7BN3IFebmEUc9eoY0LCRZOTC8qHuyf2MsJZ9ii6w=; b=wGhGxQs5iKFzxJWxAEHuPH79/ubQrOcKB4z+phJmdw3rl9qxWfv2OmzpBcbfBALPklYr43 FREqNbl8W5O55IA/2mZ5hPjQR0QeET8G+4LwICRwM8pu8OPQxbO3VYw8pDYzevY32xHh9J LaO3Pj2ldl7vNIRZW2lKYdpHIiGlFxBBl5U2Y2VgCIv9E7rko9PwO0zYGqkTQSJ784chrp Sr0CnJVtAZcegfiMt/wCSbPOsZaYqcJu9UCZVP5KbM6z5TDuiuUDSjqIOAPLlYWVJ+HD0U KepRdoWJPFlMboc3H00OunHM777taZgZ3TbZB70jTh1VAc4TdHz7fo/98YN7EQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1706779829; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=xRt7BN3IFebmEUc9eoY0LCRZOTC8qHuyf2MsJZ9ii6w=; b=I2mOzbh+TfLa/FCi1s6InoTwXNWz+BuPB0d6X2U7bfHRelLs9TBwyNFvF6a1jvRm6akoTx RePkgx43pzak9HOiPANWkoAjA4PDoJ3Eecqacu5Mij8KIJmTxB5qHCy1Nr6syEVCFEJvpB OCRqvGDGfvJMVKxcSlPz5us7oANzOsULJpIHYDimrXWwhZMhC+YG+bLfQ8e6bNxOHkypOw OMBTJOQhpNX7YyvEg49W5g3Jx/7cPaM3YpTL6GzBBjn4PsBpmZDdCXJdlbdGx54uceKsOv HIzc4y6XgGRYEGdTG19QGiQTV2lXgnVKTrqkMf0pG76JdSptzN+GTHsQDLDRiw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1706779829; a=rsa-sha256; cv=none; b=UslOL0NTGahM/x+eoqzNpj6VWWwgL/6Yb8Z5MjkJoyJU37GrVs3P/+I2jyOB57lBYmjEzC sA3ozuzkDG8RIMHABu3XaLktOVk41/YUJcDoruj4m9dbfm2MRvOben5FFqVhgJjkRD6rTn vGOeglAPWdOqbbsY9XTaZu97ugdmHRL12tQyUjt1T5jF035ebQHR1heKX5tEpvX1jcM0h0 RczhMBqDsa8CM5wV0s3NCl3YF5zQKRgs6uLv7X6AZnm4FgtXp+BDBeplHZzlY2GgMNz8q+ 5n3eunO1f+8B/XpjoHc/3+uu0fGokQfWuFpta+PbpY7R4Xpun5P7SdqMN+24vA== Received: from [IPV6:2001:1c00:2709:2010:1440:df01:b63e:449c] (2001-1c00-2709-2010-1440-df01-b63e-449c.cable.dynamic.v6.ziggo.nl [IPv6:2001:1c00:2709:2010:1440:df01:b63e:449c]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: ronald/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 4TQYY06PN7z1HpB; Thu, 1 Feb 2024 09:30:28 +0000 (UTC) (envelope-from ronald@FreeBSD.org) Message-ID: <8100aebb-94d8-4e12-b03f-6f3d7a733921@FreeBSD.org> Date: Thu, 1 Feb 2024 10:30:39 +0100 List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: sysctl net.link.ether.bridge.ipfw not working To: Richard Bader , freebsd-arm@freebsd.org References: <772ba50d-bb2d-4432-a1df-dcf250db640a@bader-muenchen.de> Content-Language: en-US From: Ronald Klop In-Reply-To: <772ba50d-bb2d-4432-a1df-dcf250db640a@bader-muenchen.de> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit On 1/18/24 07:58, Richard Bader wrote: > Hello, > > Os: FreeBSD border2.bader.loc 13.2-RELEASE-p9 FreeBSD 13.2-RELEASE-p9 releng/13.2-n254652-c78c31d2ef40 GENERIC amd64 > > i'm trying to setup a 'filtering-bridge' (https://docs.freebsd.org/en/articles/filtering-bridges/) but the mentioned > > systctl does not exist: > > root@border2:~ # sysctl net.link.ether.bridge.ipfw=1 > sysctl: unknown oid 'net.link.ether.bridge.ipfw' My system does have '`net.link.bridge.ipfw'. BTW You send this networking question to a mailing list about ARM while you are running on amd64. I think you would have got more reply on the more general freebsd-questions@ or freebsd-stable@ mailinglist. Or maybe freebsd-net@. Regards, Ronald. > > > trying to compile the 'options bridge' results in > > > -------------------------------------------------------------- >>>> stage 1: configuring the kernel > -------------------------------------------------------------- > /usr/src/sys/amd64/conf/MYKERNEL: unknown option "BRIDGE" > --- buildkernel --- > > > any ideas? > > > best > > richard > > > > From nobody Sat Feb 3 21:45:12 2024 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TS5m80nxjz58VY4 for ; Sat, 3 Feb 2024 21:45:28 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic305-21.consmr.mail.gq1.yahoo.com (sonic305-21.consmr.mail.gq1.yahoo.com [98.137.64.84]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4TS5m71lW4z4Grl for ; Sat, 3 Feb 2024 21:45:27 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=X62l1d+9; dmarc=pass (policy=reject) header.from=yahoo.com; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.64.84 as permitted sender) smtp.mailfrom=marklmi@yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1706996725; bh=HLAYlccb9ji9SQ688wFNboNnrA0rDdoxdqGZqjRoknc=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=X62l1d+9Cd6BZGXA3S0jJs1BzvRbeuryH4VVc+fKi0xcIGRdkcjKTsy0WMQISJ0cWIj+7CvPfr3kwE3qkoc0CLqs2TQEnJX7mL9LRROlHVJXdXzUC2TTlqOkJOAA8TcXX6f+THSKw282ckkfkbmXYGcuzd84CjHiqgEEnpZeI3lrnfvZ7RL1vg4jrLFgW+K44FiKBNw83w3jkpFkMwhxodQ2PY9aygn/WiUYRTVTdgNNTMriZzwF5GluA4Ta3qyoEf2x2yazMeo6cvmdWlHnnfhpiGqr6nWf8T6viVLjrdkwc1ywWdGRbIh6R5SQwaK/GaopRErhfsKtj9U95GxTHw== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1706996725; bh=UIaXOkIm1lNmGjpSMOTZiX9IentHQKXHW3WTB3PUoiX=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=R96e6QyvDqTJb2H5rVfMW27u7D6ht6mt1uoURCEM6xZu/kj/pEAx+x4vzlAQF9A3HotGRJ3zJ23P1wtgCK9j8J9EYmB465KWo2U3UJ709Skm4EDXsK6iGyBehIcgI4n4s1CcYtiOPJkXRYKHNS0gXfGbQ4C4Xb8D7Q/afmGYYMUT2psBcCWA51c7/uCwvswPDcDTAnqO6XlsxeTrKX9TQp6N3UEZMwAmKqnjoUYW+XNmwnZwCQb9UN+0xGufsv2cq09pMt26DgSvWLhBh+QIAIMBIRRffewVfCw1HlM0QpgWi8lBXIh4AdB6zMcisYDftkwBtlzrQMY8LfAljLo3oA== X-YMail-OSG: 5W83zE0VM1lslJkEobqRHLnXyCo2lZSnLysdL9X3P8GHhpNQvMoYsDEYSjTgUAs YShu.ijo_jC8uDzCJto2B6StpUABZ7Cb4zloelIsC.xE.J2PbeOgYJq0hWvwR.ojFZ.mj3k2opTp V8xNoiO_LjpQYDtiQiqtrVoXh1ysT_A2p895oRIYW562RaVQtTZc2Ev6A4uwUTWoDmopMt2DOviz fVYfebmdYTv_pfGA9x1oe8BzRVtM_J4wPWElUyZ1iWK9QvizeFYCeoMsCVLSaIgwUbhH.hfpNZ_b uhBlx6BUSpNpvbogZ_RHahanb9iACTvDuIx.Fgjn1MCijOWn0gQjRWcrtxglbbUzCHJmREoDeDi2 JEBHtm0jvS0sTOtQepRVfDGZy2nJEd8F6GfIdID2syfbZwwxXrnZTd72G2iFF4YwMHjzdK8FqD1h 40MLUIeoBow5ioOZS0ZrINo6DCorGxYsI6ScaSa_E3XiTsek5t4zSqnmYn2AsAp_BElhYubUiCJy xf60Q9t_3zm0HNrqMjn8EvHdWMUxKUMbBueptil9_sxpqE4bY1YLJ2SLBuslYoK_KbDDRnOc2uL. wq9aBby0tSFZmyyVWdHiWbwcjtOURL6WyUnfZwnya7n9C.CnFJExNCICWuIZZQladxFYWOQf1I93 _PPc83pKpdzbadHKvcT_d934t1cF_l3qncKv3CtHCu.ba3NBuMvMXa5lJLjyDH4JsGjOl9PHOCmq gl7hT0F.gSwfoouTDVzB6WebBOc3BT9JBJF9.5J..aXf8P.4piOGwPrpnb3cnk.mkkOqUGr24b9M yQce4ck_cGKlVufE2.GbpwWj0chrK.7l_w6cs96fVHpJ.ZIWYxTSX5vr2wR9OOLhuHg0HSxRxlLy bQgdffsKi8Qp7MSHeo_pzG8jwF7uYNgsOnltFQ6wfE_4xIgTLYU0QmNsOFTkesaO0H7TzRDWGu9V jzPEy5oiROMHQbyFmX1pL2_NINgEcXSG2_lAX8XeXmtfqsyGQBjTikwt5tLeRJJlGwvMzX7n2FHN A0GKTVPdE.GnRDQ1hgObiU89uMpCXpuyxAnosrBi2fwa7Wy1VMofUTwLZYYpjrlEzFnyLxk.PwSs EmCx.pCIWDay2BaG0hRtGn2dVqlJgSCLtUX9L5JZEOJX6nDFFQL_Z2oiVcAM0vKrg_QqD0wlpH76 m9fh2Pn8zLgVnUQMaoXDT062GhK85.UZXlk8VLJ3anAC4BFrLs0F8xNGOtYCt6Bsg_NoV3XvEih_ w7NH9kpiXeQEBOJOIfF.OBk5Xe5s6JtlwOFtnieGNfn4X6TuD_Pn_YIFXDJpPcUEncq_Ad5qbQSa mw7coD_VSxi3agNHxQJx.2nSC41mUlFnlzq8_wry52Mfd4O.v2DI6ntd65ZRCYbMD4zw5icYbTMc BEg3sG15R3ariKLXmQSyhiVRFI4VJh5sHKFO8DKMy9789vgzaYakSfof9rZVUF0Jhi.riADnkBlM XrhMduSa9F2fYTtp4mdv.uwOi9Bbu7l6y8rNenuILNjTg56bSPQxXIDtFrAQwA2KrWKpmtVJFMmj orxtT28PglrI1Oom9VirSw3EGXbMH7Yo24Qhbx6l73qOUXTetGU4uyX69dUseWwwplBXYpsqVK12 58iQhbU1ZWXCl17mJibN4xXXruO.AL0PXewniAHZfE_MmMTn3yH9L3gIx4QYLM8rSoUFkFzwZhnh YAcab_JgtwAs.lNfO3pt6YJ.OYbi.TiBdnyaaj4Fzej0EpvgX3zFT7YLnsf80FLgq24SfkdmWXKq A5G812OdvUaXHQXLQCYzS.UhYD3r1wXyvVBYAUhFxbvyrQ.bRD456ID_FL0BzqhsutqFKuvM7xv9 NNEuy2U_ASc2x8FB9gLSnKc3CmPLL5pZKJmCboSKjh15ImszyImvLqQL.1bgWrnOzp9.9GE6hcKO 6pjWX8lcV2JVBUHtqr39HUSLgOeUzVxHyoCIr3bhq70maf2FjCA4BugENkPWXd.__kBQ6j28nkVj uS5PrqrwUAnDTwxh3IelJiuC7XXKI.UlLR0BF5ok1xZ.rYOYODGavM.3X4NQeAk9u9pFijaozmDa sC3rPyBkZY2_lGdndCAIWf.Tj1zqsNShbodRaMl.YQbBYW6tSRvAibtu4TMDIpAAqFDU01l98aHT YWJywUsyFUp1RwEM02ZOkWmw_VmUDDRo1_xsIyyEa_9TJ5P.VDLxDWvuEYOSNsgJ_oyx9CEZeeHO hVNZs5xqE6DMiNE0i9XI_B9Q0zkVZhkJX_YAQM7gmhDWwz8elyuYkBJvXjwvLqODuCkBfBQ-- X-Sonic-MF: X-Sonic-ID: e2211b9d-b7c3-4a89-b693-139954d72d46 Received: from sonic.gate.mail.ne1.yahoo.com by sonic305.consmr.mail.gq1.yahoo.com with HTTP; Sat, 3 Feb 2024 21:45:25 +0000 Received: by hermes--production-gq1-5c57879fdf-bmngc (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 147d5a4820645b34c7ef1c137bdba5a4; Sat, 03 Feb 2024 21:45:23 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3774.300.61.1.2\)) Subject: Re: When will FreeBSD support RPI5? [avoid all USB use if using EDK2 to boot] From: Mark Millard In-Reply-To: Date: Sat, 3 Feb 2024 13:45:12 -0800 Cc: Jesper Schmitz Mouridsen , John Kennedy , ykla , FreeBSD ARM List Content-Transfer-Encoding: quoted-printable Message-Id: References: <5a39810c-5fd8-4969-a222-2561b050b035@FreeBSD.org> <347FE009-A470-4765-A9B9-7C9AB5E954DA@yahoo.com> To: Doug Rabson X-Mailer: Apple Mail (2.3774.300.61.1.2) X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.49 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.985]; MV_CASE(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MIME_GOOD(-0.10)[text/plain]; FREEMAIL_CC(0.00)[freebsd.org,phouka.net,gmail.com]; TO_DN_ALL(0.00)[]; RCVD_TLS_LAST(0.00)[]; ARC_NA(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; MIME_TRACE(0.00)[0:+]; RCVD_IN_DNSWL_NONE(0.00)[98.137.64.84:from]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; FROM_HAS_DN(0.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RCPT_COUNT_FIVE(0.00)[5]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; MID_RHS_MATCH_FROM(0.00)[]; MLMMJ_DEST(0.00)[freebsd-arm@freebsd.org]; RCVD_VIA_SMTP_AUTH(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.64.84:from]; SUBJECT_HAS_QUESTION(0.00)[] X-Rspamd-Queue-Id: 4TS5m71lW4z4Grl I'll note that all use of USB (XCHI being involvoed) is subject to = massive data corruptions on the RPi5 when used via the EDK2 as EDK2 now exists. That includes booting via USB media. This is not limited to FreeBSD: Linux and Windows 11 too, for example. No OS is known to operate without such problems. QUOTE of https://github.com/worproject/rpi5-uefi?tab=3Dreadme-ov-file : In ACPI mode ACPI support is currently under development and limited to a few devices = that have existing driver bindings. Warning USB is unreliable and may cause data corruption on all supported OSes. = We're currently investigating this issue, see: #3. END QUOTE #3 is: https://github.com/worproject/rpi5-uefi/issues/3 EDK2's USB I/O for its own purposes uses polling and seems to work okay. =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Sun Feb 4 08:09:16 2024 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TSMcH4GD8z59HjC for ; Sun, 4 Feb 2024 08:09:35 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic313-21.consmr.mail.gq1.yahoo.com (sonic313-21.consmr.mail.gq1.yahoo.com [98.137.65.84]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4TSMcG4j3xz3xLS for ; Sun, 4 Feb 2024 08:09:34 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=NyQ41Myp; dmarc=pass (policy=reject) header.from=yahoo.com; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.65.84 as permitted sender) smtp.mailfrom=marklmi@yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1707034172; bh=7ShX3SA1OIKcGQTYy3Dvd+zBeu7EQdGa/K9q4NH0/6g=; h=From:Subject:Date:References:To:In-Reply-To:From:Subject:Reply-To; b=NyQ41MypwWLRoVf6zRBNSTckFVqzu7CU11+ZLcl8sX94VigwIUfYrSOLRLO1vrzUxw9q0oVIMUszbmSdozT7b4Q6g5Mh2ihIWxoczYNpqmQI0MQVRn/nTxTpAdoa4y1Vk8WXIdkNPjYKhwhm/7HdTgIOzyWFDfO5qmmWFHJQKzT4wClfUJ2mpt7NORjjxgjoJo/G4jTG+YROonmLrWWQIM1z/6tmlhlEZaKxym956qbY/3+NFjZ/XttTQNXD0EFsku83altSSXTXwjdWgZtsHVfv7BQoyxTsfD0c9A2IIXuobVgfcjau2ytOGD94JWLdvUzC84S8LtsZIKq1mcrwfA== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1707034172; bh=T0v+rMNdlAWDDWokvNfth7DIsTXcOvB/GCbDPyqLm3S=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=avdulVFeMu72eUUEnwCQtrSWs8cD2oSq4yQzv7IEJO8ugr1kSkqwU/73xpNFR4byWiS68a5l3tgV1e2c87s9H6EJs6mkhX3eiQNWKl2oLMrKQHRGruBXcHS5lKeWAO4h3mZ3/P7W7VizwxJfAYWXRv8BLBOhR2ZWa3kErbnXwEGZ5EJiCQVPp3Kg4evGgk5+Z+MLHFmY0YCe97cNADeeu3JCQ5a7BlBmGdZUpeCEqX+MX2xFP94PWn+WFL8RHdkkOj5fuBPsfo9RiDZuhBJPp5NA2RszS/43qeA0JClM3tmC8wskXNUngDdRz84sByeR2rpGclqQaNi2cMz2z3vIog== X-YMail-OSG: EmlDk_0VM1leZ19nNM6US8NZdRiTLsV8OFmpbc2Am_H6gSrngSrdM3v8IsEYv1F nMtikn7tjy.v.pKaUP7BjDBLB_unJcsDXsZX3kDNKRbwTPE7lGg337g1AoilvXhzMGzhEDqCDYXo DDHW9m3BXAD.xzdMv94GwNshwZPftuTfmgJJPlYJBxb9SupiwtjLWyEoy4vWES6LnTYxH7kr6Mrw AG8oJh8mGrCs6yu4RkcAT.F8qWrLZAkB59Via9u1FGZ8rstwdAa9philnwWO7g8PFxFEahJb8kJr EjWxhIJ0x7n2_bZAe7uX95_TBXm0jj0gbfJf5qICJY1injtHJuRrPGFsWAkDGzxXrEdgXSxKGi5l J6sOPZr2WBwTABg6Y_yy4B3mLnhRBtUFehv9OcTjUw7tCGoEQVDBGdrOmLVpk_.QX2vtdsfVpuy1 xvToJoZ56EYdhIuVrYBqMYtLG_fMNAKKOjFaIrhtJXg0kYPK6fjGEMPioj2hw_00Js_C.NKvB6tV zQpms9thregJLho3tkDq_8_mEjEZsojjO3XI2Dy.UZ.XT1psfpkJy2gW9CqcMsABz7W7Oj6XBeKD q62jPG1V7NfI5592zvxdcDeXDHOZZMjFY2hiMoYgVqSDXL4t_aZrlc7t_ZWAD4vbKs99a8r8eN.H 5MjHgLZ.9kq3b8nbHgb55tcPEbNrTilG6Cw9zkv78VAgI05HhN0w_oNFtMzF8owDK1EKlRBVeQ_6 Ag1_lAUxT6rGyAaLTirVYxC_wxwo.FNeEnaVwO8NM4lp33jLk.eyUT7btyJk959g0dtOsU53zbs6 bJXMNbKdpsIap5FtEV5C1PbbfvzZfpWcbiEUcU8p2Ofg8epBepr4CoAdvkcC1IPKauA_rAa.abN2 aIYfId.24VGoocRV4bET_eOcOCz77VkZrUx38WGmmMvKqJxnarmnxZnO7rHtyRKK_F8WYREeCPac F0CDjBrnwCbfAGlxHRSE5uQBj2YJWIcFCrPDupsdHvVPMqJmmz1uwMAe49FR7AufYMKNRWXDP6aN XwVITOfVOaG6GduRxJWNmaHKXSzj9pNAIQgomkSbHSfAweJOH_UQSd2bZAIl0HbayxIlQvdgZ4.b va.tdWrJqaHbUo65RvVIszkvCzQi1uiqBxGoJnxnrY5XzFHBkd9IQuUUQZILblPKuY17hApEYcsb jNfO2.slf2a5pVfsR4XVvGQdTV_mhz1Z6ni3nBXPkNBshfMPyZHFZWgnB2CRnlYbAYKE675ENsKX cnn1G6WiTNgPiYcMf0WDoA7uDDnRwd.54JSIL1x1Xc70XmoGdngzLTcomGPIKKBLozRgkrJA.DSj vGB73eo2zR1VTIfAULxxQfnGNfMixnh6IK_qkl4AzJHigFgCgfC9j0ncLYRoyV3eb90phXgZ50BB SX4BqYqKC2MDGNgj5cTyICs5gZpcX19hmQu4grSvu2h7B9g0kmJl4Gnpwq95rPsGabbnDbvWfHIj cotOGEtqVQetiYDpq9qtb4q_drKEVq.lJH7S8mEbbXY816pKPSpwxnYwRL8AZGiW3QlM.LA9Sejv WNWGhzbXPn3SuuaJJyaJmT4M595uKAU_VtW_DYQungHfs8efha5YOOBZMBOtMwpDy_Tnrz3DZMeo KAqf5ot0QCbYhi_7zb1w3fNhfVN0RoeN8evsrP27EbfHleR0fKAiz5rweRpvpy0UKrxK6GE.eGIV Vx1ZposGsY7jInTB39k2VBKxTKHQjKl9KntplzuS6C63DOkmDvXrpLD8n.1JZ0wiPcnWDbreeE7x Ust0g8ykZgPqMSbaLYBGR_j2_9CnS_xcBUd1oNGty3D7BXy1P.nXm5p5MG8x9EqMk7g1VY9vCfWd 7wlQl8K70U29bF83v9Krkrsc2a1WlxSUbjBSJqDBNwabCcFczCUSjTk730NTmmsnMPmtgJM8IpuP U0BIyXSyNuXvnp2UhFJMHyTIQ3Y4nTY5M1H11DCdF__QmP2okx_XWqo0OsTleUqA8EzBhFNvCWfl A83LTTDh1xPMwpjvSjoCKd7ZbJfXHqUFwsnGRkmqYVWOHTvgJ.3eLIZbUgs43v.XcgPeo.JoEh62 Bx0IUm3hgFiRqNU27B1lokmfCSt2dtPbNG_eKt5iHF.tl8WtI6LNwyfptxmIEk2Ir3DAx6XJNqDA by3IYtvR8w373ietqOFw_QcdCLqiFN6XnsYSV_B8EeNmDF0S0KULdjKg7QX.h0h.UAKGljn3Qnxf 7GCfl9bOzUied7O.koU3w0hTIy3tjwRzodb.WU6YQDrtDmZ9UwWM9JADAv92nhx0WR7JB0r4fo5A - X-Sonic-MF: X-Sonic-ID: 5def8680-56e0-4c2e-b6a7-2070d25653ce Received: from sonic.gate.mail.ne1.yahoo.com by sonic313.consmr.mail.gq1.yahoo.com with HTTP; Sun, 4 Feb 2024 08:09:32 +0000 Received: by hermes--production-gq1-5c57879fdf-wt62k (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 878e8b230ee84f819e937d613683d0ef; Sun, 04 Feb 2024 08:09:27 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3774.300.61.1.2\)) Subject: Re: https://github.com/pftf/RPi4 EDK2 RPi4B booting ram_attach crash re-tried via 2024-Jan-11 snapshot, with debug.rman_debug=1 and details about what is wrong Date: Sun, 4 Feb 2024 00:09:16 -0800 References: To: Mike Karels , void , FreeBSD ARM List In-Reply-To: Message-Id: X-Mailer: Apple Mail (2.3774.300.61.1.2) X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.50 / 15.00]; URL_IN_SUBJECT(1.00)[github.com]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; TO_DN_ALL(0.00)[]; FREEMAIL_TO(0.00)[karels.net,f-m.fm,freebsd.org]; MIME_TRACE(0.00)[0:+]; ARC_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; FREEMAIL_FROM(0.00)[yahoo.com]; DKIM_TRACE(0.00)[yahoo.com:+]; FROM_HAS_DN(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.65.84:from]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; MLMMJ_DEST(0.00)[freebsd-arm@freebsd.org]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.65.84:from]; MID_RHS_MATCH_FROM(0.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RCVD_VIA_SMTP_AUTH(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim] X-Rspamd-Queue-Id: 4TSMcG4j3xz3xLS I did some more investigation (EDK2 code and Linux handling) and then got an independent rpi4-uefi-dev "Mario" confirmation of the following about the EDK2 implementation: QUOTE It is indeed a mistake to expose it in _CRS like this, because it does not mean the same thing in the CPU's view of memory. 0x7EXXXXXX is mapped as DRAM in Arm space. END QUOTE So the FreeBSD panic/crash has exposed an error in the RPi4B EDK2 design (lack of address space identification based handling for BCM2844's (a.k.a. \_SB_.GDV0.PWM0 's) [0x7e20c000, 0x7e20c027]). That FreeBSD sees 0x7e20c000..0x7e20c027 as an ARM "Low Peripheral" System RAM address range is what EDK2 is reporting via the _CRS it uses. So the split: QUOTE splitting region in three parts: [0, 0x7e20bfff]; [0x7e20c000, 0x7e20c027]; [0x7e20c028, 0xfd57ffff] END QUOTE is following what EDK2 indicated to do for the range. But FreeBSD later interprets other material as having a range that spans the 0x28 bytes already reserved: ConventionalMemory 000040000000 000000000000 000bc000 WC WT WB which indicates no hole exists in the range. This results in the attempt: QUOTE ram0: reserving memory region: 40000000-fc000000 rman_reserve_resource_bound: request: [0x40000000, 0xfc000000], length 0xbc000000, flags 0, device ram0 . . . s->r_start (0x7e20c028) + count - 1> end (0xfc000000) no unshared regions found panic: ram_attach: resource 5 failed to attach END QUOTE So, likely, the only question is if the handling should be a panic vs. a error report with error handling that would allow continuing. (But there might not be a generally good way to set up for continuing.) It appears that Linux handles it (views it) as (quoting Mario): "Ultimately it shouldn't cause any issues, it's just reserving away a bit of usable RAM." So: no error reports, no warnings, and no rejection happen. (I've no clue if EDK2 will be updated now that the issue is publicly reported/known. But I doubt Linux will start reporting warnings or such.) Linux shows its results for the EDK2 oddity as: /sys/bus/acpi/devices/BCM2844:00/path : \_SB_.GDV0.PWM0 /proc/iomem : . . . 40000000-fbffffff : System RAM 7e20c000-7e20c027 : BCM2844:00 . . . ff20c000-ff20c027 : BCM2844:00 . . . (That last is what the valid ARM "Low Peripheral" address space range actually is for the 0x28 Bytes. The _CRS had that too. The _CRS just is inappropriate for describing addresses in a pair of address spaces with an address offset involved for going back or forth between the spaces.) === Mark Millard marklmi at yahoo.com From nobody Sun Feb 4 10:43:22 2024 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TSR202K1Bz59Wyr for ; Sun, 4 Feb 2024 10:43:36 +0000 (UTC) (envelope-from ordinarybit@proton.me) Received: from mail-4325.protonmail.ch (mail-4325.protonmail.ch [185.70.43.25]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "protonmail.com", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4TSR1y21jvz4GKk for ; Sun, 4 Feb 2024 10:43:34 +0000 (UTC) (envelope-from ordinarybit@proton.me) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=proton.me header.s=protonmail header.b=jDinsGHW; dmarc=pass (policy=quarantine) header.from=proton.me; spf=pass (mx1.freebsd.org: domain of ordinarybit@proton.me designates 185.70.43.25 as permitted sender) smtp.mailfrom=ordinarybit@proton.me DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=proton.me; s=protonmail; t=1707043411; x=1707302611; bh=wlVdGJXn5mU/dZlKjtP0vzCBqJqwjPdrwcKj/KqvN9A=; h=Date:To:From:Subject:Message-ID:Feedback-ID:From:To:Cc:Date: Subject:Reply-To:Feedback-ID:Message-ID:BIMI-Selector; b=jDinsGHWML83yhG0ZpLAQRTjePEGAXboMhZIEuC2S8uyHuLv5cJXobUisb18QYRTn 4W/DzDGEreFiatkjrx2SwE5VEWF2egDnDw/No9MZQwZserqEdEujaFN59rie2v8clI TKNbqaho53Da2K7lfw4/S7iaJa0DWC1WkHR5V6pUrT5O+7/HuiDkCOtDRbT23HK6i9 qR7cwLeaIn0/896C1Qe3BmJFwyxZ+HvejjN24uvhvOjHEhf9xCLN/B1aXLwotK1nZb 2Z5mhiQHsPLqg6XbAgVaQ2cFpW6v3Mlu9FyTvPIBw3qRAt37TrhMCsXXVGVHt3rK7K hBNG4X9gpvG2g== Date: Sun, 04 Feb 2024 10:43:22 +0000 To: "freebsd-arm@freebsd.org" From: Ordinary Bit Subject: Increase RPi MMC/SD clock speed Message-ID: Feedback-ID: 100108111:user:proton List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="b1_IXqfuBXfinf5zHeJtNSKmxbwYGEsdWaKzWNGEczLKc" X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.30 / 15.00]; MIME_BASE64_TEXT_BOGUS(1.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[proton.me,quarantine]; RWL_MAILSPIKE_EXCELLENT(-0.40)[185.70.43.25:from]; R_DKIM_ALLOW(-0.20)[proton.me:s=protonmail]; R_SPF_ALLOW(-0.20)[+ip4:185.70.43.0/24]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; MIME_BASE64_TEXT(0.10)[]; MISSING_XM_UA(0.00)[]; ASN(0.00)[asn:62371, ipnet:185.70.43.0/24, country:CH]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCPT_COUNT_ONE(0.00)[1]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; RCVD_COUNT_ZERO(0.00)[0]; TO_DN_EQ_ADDR_ALL(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; HAS_PHPMAILER_SIG(0.00)[]; MLMMJ_DEST(0.00)[freebsd-arm@freebsd.org]; DKIM_TRACE(0.00)[proton.me:+] X-Rspamd-Queue-Id: 4TSR1y21jvz4GKk This is a multi-part message in MIME format. --b1_IXqfuBXfinf5zHeJtNSKmxbwYGEsdWaKzWNGEczLKc Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: base64 SGksCgpJJ20gY2hlY2tpbmcgbXkgUlBpIE1NQyByZWFkZXIncyBkZWZhdWx0IHNwZWVkIG9mIDUw IE1IeiBpZiBpdCBjYW4gYmUgaW5jcmVhc2VkPyBCZWNhdXNlIEknbSB2ZXJpZnlpbmcgbXkgU2Fu RGlzayBtaWNyb1NEIGNhcmQgcmVhZC93cml0ZSBwZXJmb3JtYW5jZS4gSSB3YW50IHRvIGtub3cg aWYgdGhlcmUncyBhIGRpZmZlcmVuY2Ugd2hlbiBJIGluY3JlYXNlIGl0IHRvIHNvbWV0aGluZyBs aWtlIDgwIE1IeiBvciAxMDAgTUh6IHNwZWVkLgoKcm9vdEBzZC11bHRyYTovbW50L2Jvb3QgIyBk bWVzZyB8IGdyZXAgbW1jCi4uLgptbWMwOiA8TU1DL1NEIGJ1cz4gb24gc2RoY2lfYmNtMG1tY3Nk MDogNjRHQiA8U0RIQyBTQzY0RyA4LjAgU04gNEMxRTk2NzggTUZHIDEwLzIwMjMgYnkgMyBTRD4g YXQgbW1jMCA1MC4wTUh6LzRiaXQvNjU1MzUtYmxvY2sKClNvLCBJIGFkZGVkIHRoZSBkZWZhdWx0 IC9ib290L21zZG9zL2NvbmZpZy50eHQgbGluZSBvZiBkdG92ZXJsYXk9bW1jIHRvIGR0b3Zlcmxh eT1tbWMsb3ZlcmNsb2NrXzUwPTgwIGFuZCB0aGVuIHJlYm9vdCBteSBSUGkgYnV0IGluIHRoZSBk bWVzZyBpdCdzIHN0aWxsIHRoZSBzYW1lIDUwIE1IeiBhcyBzaG93biBhYm92ZS4KCkFueSBpZGVh IGlmIHRoaXMgaXMgcG9zc2libGUgb3IgZGlkIEkgYWRkZWQgdGhlIHBhcmFtZXRlciBjb3JyZWN0 bHk/CgpUWSwKT3JkaW5hcnkgQml0CgpTZW50IHdpdGggW1Byb3RvbiBNYWlsXShodHRwczovL3By b3Rvbi5tZS8pIHNlY3VyZSBlbWFpbC4= --b1_IXqfuBXfinf5zHeJtNSKmxbwYGEsdWaKzWNGEczLKc Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: base64 PGRpdiBzdHlsZT0iZm9udC1mYW1pbHk6IEFyaWFsLCBzYW5zLXNlcmlmOyBmb250LXNpemU6IDE0 cHg7Ij5IaSw8L2Rpdj48ZGl2IHN0eWxlPSJmb250LWZhbWlseTogQXJpYWwsIHNhbnMtc2VyaWY7 IGZvbnQtc2l6ZTogMTRweDsiPjxicj48L2Rpdj48ZGl2IHN0eWxlPSJmb250LWZhbWlseTogQXJp YWwsIHNhbnMtc2VyaWY7IGZvbnQtc2l6ZTogMTRweDsiPkknbSBjaGVja2luZyBteSBSUGkgTU1D IHJlYWRlcidzIGRlZmF1bHQgc3BlZWQgb2YgNTAgTUh6IGlmIGl0IGNhbiBiZSBpbmNyZWFzZWQ/ IEJlY2F1c2UgSSdtIHZlcmlmeWluZyBteSBTYW5EaXNrIG1pY3JvU0QgY2FyZCByZWFkL3dyaXRl IHBlcmZvcm1hbmNlLiBJIHdhbnQgdG8ga25vdyBpZiB0aGVyZSdzIGEgZGlmZmVyZW5jZSB3aGVu IEkgaW5jcmVhc2UgaXQgdG8gc29tZXRoaW5nIGxpa2UgODAgTUh6IG9yIDEwMCBNSHogc3BlZWQu IDxicj48L2Rpdj48ZGl2IHN0eWxlPSJmb250LWZhbWlseTogQXJpYWwsIHNhbnMtc2VyaWY7IGZv bnQtc2l6ZTogMTRweDsiPjxicj48L2Rpdj48ZGl2IHN0eWxlPSJmb250LWZhbWlseTogQXJpYWws IHNhbnMtc2VyaWY7IGZvbnQtc2l6ZTogMTRweDsiPjxzcGFuPnJvb3RAc2QtdWx0cmE6L21udC9i b290ICMgZG1lc2cgfCBncmVwIG1tYzwvc3Bhbj48ZGl2PjxzcGFuPi4uLjxicj48L3NwYW4+PC9k aXY+PGRpdj48c3Bhbj5tbWMwOiAmbHQ7TU1DL1NEIGJ1cyZndDsgb24gc2RoY2lfYmNtMDwvc3Bh bj48L2Rpdj48c3Bhbj5tbWNzZDA6IDY0R0IgJmx0O1NESEMgU0M2NEcgOC4wIFNOIDRDMUU5Njc4 IE1GRyAxMC8yMDIzIGJ5IDMgU0QmZ3Q7IGF0IG1tYzAgNTAuME1Iei80Yml0LzY1NTM1LWJsb2Nr PC9zcGFuPjwvZGl2PjxkaXYgc3R5bGU9ImZvbnQtZmFtaWx5OiBBcmlhbCwgc2Fucy1zZXJpZjsg Zm9udC1zaXplOiAxNHB4OyI+PHNwYW4+PGJyPjwvc3Bhbj48L2Rpdj48ZGl2IHN0eWxlPSJmb250 LWZhbWlseTogQXJpYWwsIHNhbnMtc2VyaWY7IGZvbnQtc2l6ZTogMTRweDsiPjxzcGFuPlNvLCBJ IGFkZGVkIHRoZSBkZWZhdWx0IC9ib290L21zZG9zL2NvbmZpZy50eHQgbGluZSBvZiBkdG92ZXJs YXk9bW1jIHRvIDxzcGFuPmR0b3ZlcmxheT1tbWM8L3NwYW4+LG92ZXJjbG9ja181MD04MDwvc3Bh bj48c3Bhbj48L3NwYW4+PHNwYW4+IGFuZCB0aGVuIHJlYm9vdCBteSBSUGkgYnV0IGluIHRoZSBk bWVzZyBpdCdzIHN0aWxsIHRoZSBzYW1lIDUwIE1IeiBhcyBzaG93biBhYm92ZS48L3NwYW4+PC9k aXY+PGRpdiBzdHlsZT0iZm9udC1mYW1pbHk6IEFyaWFsLCBzYW5zLXNlcmlmOyBmb250LXNpemU6 IDE0cHg7Ij48c3Bhbj48YnI+PC9zcGFuPjwvZGl2PjxkaXYgc3R5bGU9ImZvbnQtZmFtaWx5OiBB cmlhbCwgc2Fucy1zZXJpZjsgZm9udC1zaXplOiAxNHB4OyI+PHNwYW4+QW55IGlkZWEgaWYgdGhp cyBpcyBwb3NzaWJsZSBvciBkaWQgSSBhZGRlZCB0aGUgcGFyYW1ldGVyIGNvcnJlY3RseT88YnI+ PC9zcGFuPjwvZGl2PjxkaXYgc3R5bGU9ImZvbnQtZmFtaWx5OiBBcmlhbCwgc2Fucy1zZXJpZjsg Zm9udC1zaXplOiAxNHB4OyI+PHNwYW4+PGJyPjwvc3Bhbj48L2Rpdj48ZGl2IHN0eWxlPSJmb250 LWZhbWlseTogQXJpYWwsIHNhbnMtc2VyaWY7IGZvbnQtc2l6ZTogMTRweDsiPjxzcGFuPlRZLDwv c3Bhbj48L2Rpdj48ZGl2IHN0eWxlPSJmb250LWZhbWlseTogQXJpYWwsIHNhbnMtc2VyaWY7IGZv bnQtc2l6ZTogMTRweDsiPjxzcGFuPk9yZGluYXJ5IEJpdDxicj48L3NwYW4+PC9kaXY+PGRpdiBz dHlsZT0iZm9udC1mYW1pbHk6IEFyaWFsLCBzYW5zLXNlcmlmOyBmb250LXNpemU6IDE0cHg7Ij48 YnI+PC9kaXY+DQo8ZGl2IGNsYXNzPSJwcm90b25tYWlsX3NpZ25hdHVyZV9ibG9jayIgc3R5bGU9 ImZvbnQtZmFtaWx5OiBBcmlhbCwgc2Fucy1zZXJpZjsgZm9udC1zaXplOiAxNHB4OyI+DQogICAg PGRpdiBjbGFzcz0icHJvdG9ubWFpbF9zaWduYXR1cmVfYmxvY2stdXNlciBwcm90b25tYWlsX3Np Z25hdHVyZV9ibG9jay1lbXB0eSI+DQogICAgICAgIA0KICAgICAgICAgICAgPC9kaXY+DQogICAg DQogICAgICAgICAgICA8ZGl2IGNsYXNzPSJwcm90b25tYWlsX3NpZ25hdHVyZV9ibG9jay1wcm90 b24iPg0KICAgICAgICBTZW50IHdpdGggPGEgdGFyZ2V0PSJfYmxhbmsiIGhyZWY9Imh0dHBzOi8v cHJvdG9uLm1lLyIgcmVsPSJub29wZW5lciBub3JlZmVycmVyIj5Qcm90b24gTWFpbDwvYT4gc2Vj dXJlIGVtYWlsLg0KICAgIDwvZGl2Pg0KPC9kaXY+DQo= --b1_IXqfuBXfinf5zHeJtNSKmxbwYGEsdWaKzWNGEczLKc-- From nobody Sun Feb 4 21:00:17 2024 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TShjZ6rpyz58nfZ for ; Sun, 4 Feb 2024 21:00:18 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4TShjZ122nz4JMZ for ; Sun, 4 Feb 2024 21:00:18 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1707080418; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=r1xckndO4hp5iwWKwaNAZhn0Js0QwkivMRihpUB7zio=; b=HwR//0FhZVXG7ai0Yj8xWhE16Yu0Iq0/k04c9yBoDAHDth1v1ccUX88X243Ea8vI6pL5XV v6y42cTIGfJm2K2jYeEOqy4NThKeoJ8YLSDq+a1Mgd1F9qwxholk+UQGqEKmE7a1/lwjOK 1Rdr6R75gttvbXT4vhzoaMaxVGHwGTs6XF8tt8AG0Bq2RR/0l0/cXDsRXuFsOBUdv89eGB tWgbR471uUYsqkHeQdMe2G+Cj1zSYbAYyaiszvKmHyUiKFz8Z9rwep21kDs9ykMmAJ+ewm dw0yAfr+ZDoAlsGaxd6QVfLKilfIdI+6mroaUv50Nhi4EV+iudX1dahxA6FpUA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1707080418; a=rsa-sha256; cv=none; b=yibAvegRQsG3kbJLSLPIbO1bjjkOihI7TxHNkZuyGdnq2RDILL21DS7wRox0DW4FYqxdXW SEUihhOQgu1azA8wFSKjRMklD7vtCKiNVOYMsb81OOjH31AupXlT1Kpt9HNd03RoVUSN7r YSe3TwdNKQSE9B2jPfPEBORg8lYJ7T2A6VKw5sX51cUi/qGfTnz0pEg3jJ4iElqSUhZuik USgEqFRlGgBnP/zBP2DJHvdDi6uDqyr0UOIelR1CTDiFkV483q0ngLi63r4j3Qv5abZeGi b386EBtRR7JRyLc8JYIuj+jbzL17ZnXAyD/oa9LQTAWgOeWRb/e0wVTCIfh4wQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4TShjZ046pz1BRV for ; Sun, 4 Feb 2024 21:00:18 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 414L0H1j028303 for ; Sun, 4 Feb 2024 21:00:17 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 414L0HRB028302 for freebsd-arm@FreeBSD.org; Sun, 4 Feb 2024 21:00:17 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202402042100.414L0HRB028302@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: freebsd-arm@FreeBSD.org Subject: Problem reports for freebsd-arm@FreeBSD.org that need special attention Date: Sun, 4 Feb 2024 21:00:17 +0000 List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="17070804178.25fA.24290" Content-Transfer-Encoding: 7bit --17070804178.25fA.24290 Date: Sun, 4 Feb 2024 21:00:17 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 257670 | mpr(4): SAS3008 PCI-Express Fusion-MPT SAS-3: Fat Open | 264574 | sdhci(4): Support ACPI attachment in BCM2835_sdhc 2 problems total for which you should take action. --17070804178.25fA.24290 Date: Sun, 4 Feb 2024 21:00:17 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    257670 | mpr(4): SAS3008 PCI-Express Fusion-MPT SAS-3: Fat
Open        |    264574 | sdhci(4): Support ACPI attachment in BCM2835_sdhc

2 problems total for which you should take action.
--17070804178.25fA.24290--