From nobody Mon Jan 29 08:26:58 2024 X-Original-To: emulation@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TNhHn4Wf2z58TGR; Mon, 29 Jan 2024 08:27:33 +0000 (UTC) (envelope-from mad@madpilot.net) Received: from mail.madpilot.net (vogon.madpilot.net [159.69.1.99]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4TNhHn2CYdz4fSh; Mon, 29 Jan 2024 08:27:33 +0000 (UTC) (envelope-from mad@madpilot.net) Authentication-Results: mx1.freebsd.org; none Received: from mail (mail [IPv6:fd5c:5351:d272::3]) by mail.madpilot.net (Postfix) with ESMTP id 4TNhH9558Jz6f8Z; Mon, 29 Jan 2024 09:27:01 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=madpilot.net; h= content-transfer-encoding:content-type:content-type:in-reply-to :from:from:references:content-language:subject:subject:date:date :message-id:received; s=bjowvop61wgh; t=1706516819; x= 1708331220; bh=mVr+HgxGgNrxo/9UQWcmU7j+1bBTRLVlQBE8VQGd5KA=; b=f PbxLF7legsod+BpyRNy13N/yD4SyzQQlB5SATnioR+cGPGf4lQLsQB5Ti5SgqsMP iz4AC1vIMm5Zzvoadffam98j8qhrvnWqAnxClsnQqhBd5fPkn9QhSzyOML5usuCf hHMKhhwCvsoZ1gq3aeGh/EDihO1MvWZRVqhpzoUIjxsAGoFrPv5vNmJGEU0KuBV/ 6EezCzCVxis4XdE9fY9GJ/MGg68dia6d6C+lJf5eJYrr+p/6nF7J8h0RDY6T8Hmt ATfrdAjSfgzTSbi6tR4rM1S+Clu0h8WIrOCKHoNcbCi5F4CP3fIW6g0i0MgrQ6en k9vSCCGf9URo7P8XtBOFA== Received: from mail.madpilot.net ([IPv6:fd5c:5351:d272::3]) by mail (mail.madpilot.net [IPv6:fd5c:5351:d272::3]) (amavisd-new, port 10026) with ESMTP id OAnQt_jFEwX4; Mon, 29 Jan 2024 09:26:59 +0100 (CET) Message-ID: Date: Mon, 29 Jan 2024 09:26:58 +0100 Subject: Re: qemu-user-static aarch64 lockup/race? (was Re: Python failure in poudriere on arm64 (via qemu-user-static cross compiling)) Content-Language: en-US, it To: Warner Losh , Nathan Reilly-list Cc: emulation@freebsd.org, "freebsd-arm@freebsd.org" , freebsd-pkg@freebsd.org References: <6a33726b-eb6f-418e-9fbd-6d0b9b4bfaa8@madpilot.net> <0fc7f929-6e5b-4a33-97d2-8a9c0c07d524@madpilot.net> <79a5eb0f-d04e-4c1a-9d8a-185e1fb4e4a2@madpilot.net> <5ef2ab66-25ef-45f1-aa5a-4b614eab2f40@madpilot.net> From: Guido Falsi Autocrypt: addr=mad@madpilot.net; keydata= xsBNBE+G+l0BCADi/WBQ0aRJfnE7LBPsM0G3m/m3Yx7OPu4iYFvS84xawmRHtCNjWIntsxuX fptkmEo3Rsw816WUrek8dxoUAYdHd+EcpBcnnDzfDH5LW/TZ4gbrFezrHPdRp7wdxi23GN80 qPwHEwXuF0X4Wy5V0OO8B6VT/nA0ADYnBDhXS52HGIJ/GCUjgqJn+phDTdCFLvrSFdmgx4Wl c0W5Z1p5cmDF9l8L/hc959AeyNf7I9dXnjekGM9gVv7UDUYzCifR3U8T0fnfdMmS8NeI9NC+ wuREpRO4lKOkTnj9TtQJRiptlhcHQiAlG1cFqs7EQo57Tqq6cxD1FycZJLuC32bGbgalABEB AAHNHkd1aWRvIEZhbHNpIDxtYWRAbWFkcGlsb3QubmV0PsLAeQQTAQgAIwIbAwIeAQIXgAUL CQgHAwUVCgkICwQWAgMBBQJS79AgAhkBAAoJEBrmhg5Wy9KTc0kH/RO64ORBlTbTHaUaOj8F Je5O5NU2Pt9Cyt5ZWBRvxntr1zPTJGKRPS9ihlIfqT4ZvEngQGp57EUyFbCpI0UWasTerImM tt5WACnGmCzUTB39UXx8Oy4b1EgWeTJQ747e/F1mQLXTNa6ijRBE9fYlTb4gAkPN88/wVV9v 3PZozKLTg16ghBzHM/P7Lk8L7clPEZChX1FTa/6eSt3nvzfCuTMZbBPJF/ph+q1KyPqRgVfh tyhu5dvgMoPz/ni41IfeSrkJTD5RXzdyGR9q4Z1NYeBsLkRjC4LxKAP5KqUsvlOUjKvO1byj ApYdMarol+IGkaSk9e3zVYAJkWKjn/ni8XbOwU0EUxB7QQEQAKFhrDceoPdK/IHDSmoj6SQY isvM7VdhcleS7E9DoEAVt7yMbf6HbbMVTTY6ckvwTWQssywLBXNVqxgc4WLJjzfUhgef+WE7 5M3+WFYlOVQLGZY/zEVgma1raYnOHNAOzeHLDmEXjbZP6vGAeDyBbGfQPpE7qGYZ7ubeT3Xw QO+PklcCrvOPj2ZPcAxGNS2xVU/LzONqCrJqLMJSIcCdsbiSP4G5PnDFHtMokaTY6OEr8OEQ fOAerhcHUa/z7Uu8YtmaqKH+QGkE/WEgaRqSiTnv0JOTD+DxehaqvoKPPZ++2NpCZMHB2i6A /xifmQwEiIjEXtcueBRzkNUQkxhqZyS13SrhocL9ydtaVPBzZatAEjUDDEJmAMLVFs45qfyh MiNapHJo2n3MW/E5omqCvEkDdWX/en3P7CK2TemeaDghMsgkNKax/z0wNo5UZCkOPOz0xpNi UilOVbkuezZZNg65741qee2lfXhQIaZ66yT7hphc/N/z3PIAtLeze4u1VR2EXAuZ2sWAdlKC NTlJMsaU/x70BV11Wd/ypnVzM68dfdQIIAj1iMFAD/lXGlEUmKXg5Ov2VQDlTntQoanCYrAg +8CttPzjrydgLZFq3hrtQmfc0se5yv1WHS69+BsUOG09RvvawUDZxUjW19kyeN9THaNRgow3 kSuArUp6zSmJABEBAAHCwF8EGAEIAAkFAlMQe0ECGwwACgkQGuaGDlbL0pMN5wgA4bCkX/qw EVC06ToeR6C2putmSWQMgpDaqrv65Hubo+QGmg2P4ewTYQQ4g6oYWS03qHxqVVWhKz7FjfrV +dH8qbCLfSgIcvdBha7ayGZVrsiuMLKGbw36fcmkZPpSDOfHcP0XH8Z+u9CWj0xUkTxAlZ/7 i6gYSUpG2JWNtdmE/X8VVEyXusCLwy0K0BI60A/4dRTIX3C4QKrJ3ZbUXegz70ynjHf+lQMZ 9IZKASoRMuS5FozPQh6abvmwZEPdf5I9riUElzvHrqJ8Bx0t3Pujdoth+yNHpnBxrtO8LkQd rQ58P0SwcaIX33T2U9pG8bhu5YVR88FQ8OQ0cEsPBpDncg== In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 4TNhHn2CYdz4fSh X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:24940, ipnet:159.69.0.0/16, country:DE] List-Id: Development of Emulators of other operating systems List-Archive: https://lists.freebsd.org/archives/freebsd-emulation List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-emulation@freebsd.org On 29/01/24 02:10, Warner Losh wrote: > > > On Sun, Jan 28, 2024 at 4:45 PM Nathan Reilly-list > wrote: > > > >> On 29 Jan 2024, at 8:43 am, Guido Falsi > > wrote: >> On 28/01/24 22:34, Guido Falsi wrote: >>> On 28/01/24 22:23, Warner Losh wrote: >>>> On Sun, Jan 28, 2024, 12:38 PM Guido Falsi >>> >>> >> wrote: >>>> >>>>     On 28/01/24 15:15, Guido Falsi wrote: >>>>     [snip] >>>>      > Creating repository in /tmp/packages:   0% >>>>      > >>>> >>>>     BTW, forgot to mention last time this worked without issue >>>> was around >>>>     20th December. >>>> >>>> >>>> I think this is a bsd-user issue. There is a race somewhere in >>>> that code that causes the hangs. I'd love a reproducible test >>>> case that is somewhat smaller than python... there are bigger >>>> races with the newer stuff and I've not had the time to chase it >>>> there either. 😞 >>> First of all thanks for your feedback. It encourages me having >>> someone else with better knowledge about this confirm that a race >>> condition is actually a possible cause! >>> Strange this has not been happening up to mid December. >>> My main and fully reproducible use case is actually mostly with pkg. >>> at the end of the run poudriere runs `pkg repo` to create the >>> meta files and sign the repo. It forks itself (ncpus + 2 I guess, >>> even forcing it to 1 worker I see three processes), and then >>> locks up, with all the processes stopping using CPU (ps output is >>> in my message) >>> I guess this can be reproduced with any poudriere repo with at >>> least more than ncpus packages in it. can also be reproduced >>> using `poudriere pkgclean -u ` >>> If that does not work I'm not sure how to reproduce it in other >>> ways, but I can try  writing some code mocking what pkg seems to >>> be doing, not an expert at such things, though. >> >> In case it helps further norrow doen things, It looks like the >> lockup is happening somewhere around here: >> >> https://github.com/freebsd/pkg/blob/56fa3f87d9d9644348b89680dfd8af47a860ee82/libpkg/pkg_repo_create.c#L778 >> >> and/or in the pkg_create_repo_worker() function here: >> >> https://github.com/freebsd/pkg/blob/56fa3f87d9d9644348b89680dfd8af47a860ee82/libpkg/pkg_repo_create.c#L341 >> >> >> (I'm trying to spare you the time needed to find the actual code >> being executed, I guess you would have identified this in a few >> minutes yourself, but I'm trying to make myself useful) > > > There appears to be a GitHub issue for poudriere with this, but > seems to be looking in another direction. > > https://github.com/freebsd/poudriere/issues/1009 > > This one looks quite similar. In my case the ports/pkg are aligned between host and jail, in fact I have built them from the exact same git checkout. I noticed pkg head has been converted to using pthreads instead of fork, maybe that could help. I will make time to perform some testing. > > There's a FreeBSD bug saying this is happening w/o qemu in the loop. > https://bugs.freebsd.org/276690 at > least I think that's similar. There are similarities but they are looking at the compiler, which has no relation with pkg-repo getting stuck. That's what I'm concentrating on at present. Also the sporadic issue with python is not due to compiler, it is the python binaries running during the build causing issues. > > Warner -- Guido Falsi From nobody Mon Jan 29 15:47:57 2024 X-Original-To: emulation@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TNt485mRPz58wGN; Mon, 29 Jan 2024 15:48:08 +0000 (UTC) (envelope-from mad@madpilot.net) Received: from mail.madpilot.net (vogon.madpilot.net [159.69.1.99]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4TNt474vNhz4jDp; Mon, 29 Jan 2024 15:48:07 +0000 (UTC) (envelope-from mad@madpilot.net) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=madpilot.net header.s=bjowvop61wgh header.b="n pvkqHQ"; dmarc=pass (policy=quarantine) header.from=madpilot.net; spf=pass (mx1.freebsd.org: domain of mad@madpilot.net designates 159.69.1.99 as permitted sender) smtp.mailfrom=mad@madpilot.net Received: from mail (mail [IPv6:fd5c:5351:d272::3]) by mail.madpilot.net (Postfix) with ESMTP id 4TNt404yLdz6dPK; Mon, 29 Jan 2024 16:48:00 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=madpilot.net; h= content-transfer-encoding:content-type:content-type:in-reply-to :content-language:references:from:from:subject:subject:date:date :message-id:received; s=bjowvop61wgh; t=1706543278; x= 1708357679; bh=9UEWlINe9QcufUzkwjCdZY2ErMlEqcXZ6hRYWUSihgs=; b=n pvkqHQ00jx2DwtiSot4W33EBKvxbTxdBbg5maYDZgK1vHXvWw9aTGG8QrpIJTOJO xmsLJOAHS0wwKPUeV1IYof3h9RoxtXDaw+Hj5fkTC9yVWiKqZPQ9fucawgZov6Wf xXlPoIuMTpeeohQhFA6aeDmSdnQ4pwIQQFysxM36BpN49NftTrp5RRLrC3Atn3w5 ynoG+1WQW3O/zpzJ4Rv1VAnCYdaXFs9HQ4bEALsrbWPnuS25HkA/+OCwLUDpx8oK NHK7hZUfk58vs8clO8Ck0z5KFtbocuH6GfRVzRkj8VIhl7Qij5ddAPEXoI96OXEY L0FCVoaw61BoWkjZQwEmQ== Received: from mail.madpilot.net ([IPv6:fd5c:5351:d272::3]) by mail (mail.madpilot.net [IPv6:fd5c:5351:d272::3]) (amavisd-new, port 10026) with ESMTP id ANWgLlsmXZ6F; Mon, 29 Jan 2024 16:47:58 +0100 (CET) Message-ID: <990427ae-0491-463e-92c7-c74700deb6fa@madpilot.net> Date: Mon, 29 Jan 2024 16:47:57 +0100 Subject: Re: qemu-user-static aarch64 lockup/race? (was Re: Python failure in poudriere on arm64 (via qemu-user-static cross compiling)) From: Guido Falsi To: Warner Losh , Nathan Reilly-list Cc: emulation@freebsd.org, "freebsd-arm@freebsd.org" , freebsd-pkg@freebsd.org References: <6a33726b-eb6f-418e-9fbd-6d0b9b4bfaa8@madpilot.net> <0fc7f929-6e5b-4a33-97d2-8a9c0c07d524@madpilot.net> <79a5eb0f-d04e-4c1a-9d8a-185e1fb4e4a2@madpilot.net> <5ef2ab66-25ef-45f1-aa5a-4b614eab2f40@madpilot.net> Content-Language: en-US, it Autocrypt: addr=mad@madpilot.net; keydata= xsBNBE+G+l0BCADi/WBQ0aRJfnE7LBPsM0G3m/m3Yx7OPu4iYFvS84xawmRHtCNjWIntsxuX fptkmEo3Rsw816WUrek8dxoUAYdHd+EcpBcnnDzfDH5LW/TZ4gbrFezrHPdRp7wdxi23GN80 qPwHEwXuF0X4Wy5V0OO8B6VT/nA0ADYnBDhXS52HGIJ/GCUjgqJn+phDTdCFLvrSFdmgx4Wl c0W5Z1p5cmDF9l8L/hc959AeyNf7I9dXnjekGM9gVv7UDUYzCifR3U8T0fnfdMmS8NeI9NC+ wuREpRO4lKOkTnj9TtQJRiptlhcHQiAlG1cFqs7EQo57Tqq6cxD1FycZJLuC32bGbgalABEB AAHNHkd1aWRvIEZhbHNpIDxtYWRAbWFkcGlsb3QubmV0PsLAeQQTAQgAIwIbAwIeAQIXgAUL CQgHAwUVCgkICwQWAgMBBQJS79AgAhkBAAoJEBrmhg5Wy9KTc0kH/RO64ORBlTbTHaUaOj8F Je5O5NU2Pt9Cyt5ZWBRvxntr1zPTJGKRPS9ihlIfqT4ZvEngQGp57EUyFbCpI0UWasTerImM tt5WACnGmCzUTB39UXx8Oy4b1EgWeTJQ747e/F1mQLXTNa6ijRBE9fYlTb4gAkPN88/wVV9v 3PZozKLTg16ghBzHM/P7Lk8L7clPEZChX1FTa/6eSt3nvzfCuTMZbBPJF/ph+q1KyPqRgVfh tyhu5dvgMoPz/ni41IfeSrkJTD5RXzdyGR9q4Z1NYeBsLkRjC4LxKAP5KqUsvlOUjKvO1byj ApYdMarol+IGkaSk9e3zVYAJkWKjn/ni8XbOwU0EUxB7QQEQAKFhrDceoPdK/IHDSmoj6SQY isvM7VdhcleS7E9DoEAVt7yMbf6HbbMVTTY6ckvwTWQssywLBXNVqxgc4WLJjzfUhgef+WE7 5M3+WFYlOVQLGZY/zEVgma1raYnOHNAOzeHLDmEXjbZP6vGAeDyBbGfQPpE7qGYZ7ubeT3Xw QO+PklcCrvOPj2ZPcAxGNS2xVU/LzONqCrJqLMJSIcCdsbiSP4G5PnDFHtMokaTY6OEr8OEQ fOAerhcHUa/z7Uu8YtmaqKH+QGkE/WEgaRqSiTnv0JOTD+DxehaqvoKPPZ++2NpCZMHB2i6A /xifmQwEiIjEXtcueBRzkNUQkxhqZyS13SrhocL9ydtaVPBzZatAEjUDDEJmAMLVFs45qfyh MiNapHJo2n3MW/E5omqCvEkDdWX/en3P7CK2TemeaDghMsgkNKax/z0wNo5UZCkOPOz0xpNi UilOVbkuezZZNg65741qee2lfXhQIaZ66yT7hphc/N/z3PIAtLeze4u1VR2EXAuZ2sWAdlKC NTlJMsaU/x70BV11Wd/ypnVzM68dfdQIIAj1iMFAD/lXGlEUmKXg5Ov2VQDlTntQoanCYrAg +8CttPzjrydgLZFq3hrtQmfc0se5yv1WHS69+BsUOG09RvvawUDZxUjW19kyeN9THaNRgow3 kSuArUp6zSmJABEBAAHCwF8EGAEIAAkFAlMQe0ECGwwACgkQGuaGDlbL0pMN5wgA4bCkX/qw EVC06ToeR6C2putmSWQMgpDaqrv65Hubo+QGmg2P4ewTYQQ4g6oYWS03qHxqVVWhKz7FjfrV +dH8qbCLfSgIcvdBha7ayGZVrsiuMLKGbw36fcmkZPpSDOfHcP0XH8Z+u9CWj0xUkTxAlZ/7 i6gYSUpG2JWNtdmE/X8VVEyXusCLwy0K0BI60A/4dRTIX3C4QKrJ3ZbUXegz70ynjHf+lQMZ 9IZKASoRMuS5FozPQh6abvmwZEPdf5I9riUElzvHrqJ8Bx0t3Pujdoth+yNHpnBxrtO8LkQd rQ58P0SwcaIX33T2U9pG8bhu5YVR88FQ8OQ0cEsPBpDncg== In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Spamd-Bar: - X-Spamd-Result: default: False [-2.00 / 15.00]; MISSING_MIME_VERSION(2.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; DMARC_POLICY_ALLOW(-0.50)[madpilot.net,quarantine]; R_DKIM_ALLOW(-0.20)[madpilot.net:s=bjowvop61wgh]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.10)[text/plain]; ASN(0.00)[asn:24940, ipnet:159.69.0.0/16, country:DE]; TO_DN_EQ_ADDR_SOME(0.00)[]; MISSING_XM_UA(0.00)[]; TO_DN_SOME(0.00)[]; MIME_TRACE(0.00)[0:+]; ARC_NA(0.00)[]; DKIM_TRACE(0.00)[madpilot.net:+]; MID_RHS_MATCH_FROM(0.00)[]; MLMMJ_DEST(0.00)[emulation@freebsd.org,freebsd-arm@freebsd.org,freebsd-pkg@freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_FIVE(0.00)[5]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_LAST(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; SUBJECT_HAS_QUESTION(0.00)[] X-Rspamd-Queue-Id: 4TNt474vNhz4jDp List-Id: Development of Emulators of other operating systems List-Archive: https://lists.freebsd.org/archives/freebsd-emulation List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-emulation@freebsd.org On 29/01/24 09:26, Guido Falsi wrote: > On 29/01/24 02:10, Warner Losh wrote: >> >> >> On Sun, Jan 28, 2024 at 4:45 PM Nathan Reilly-list > > wrote: >> >> >> >>>     On 29 Jan 2024, at 8:43 am, Guido Falsi >>     > wrote: >>>     On 28/01/24 22:34, Guido Falsi wrote: >>>>     On 28/01/24 22:23, Warner Losh wrote: >>>>>     On Sun, Jan 28, 2024, 12:38 PM Guido Falsi >>>>     >>>>     >> wrote: >>>>> >>>>>         On 28/01/24 15:15, Guido Falsi wrote: >>>>>         [snip] >>>>>          > Creating repository in /tmp/packages:   0% >>>>>          > >>>>> >>>>>         BTW, forgot to mention last time this worked without issue >>>>>     was around >>>>>         20th December. >>>>> >>>>> >>>>>     I think this is a bsd-user issue. There is a race somewhere in >>>>>     that code that causes the hangs. I'd love a reproducible test >>>>>     case that is somewhat smaller than python... there are bigger >>>>>     races with the newer stuff and I've not had the time to chase it >>>>>     there either. 😞 >>>>     First of all thanks for your feedback. It encourages me having >>>>     someone else with better knowledge about this confirm that a race >>>>     condition is actually a possible cause! >>>>     Strange this has not been happening up to mid December. >>>>     My main and fully reproducible use case is actually mostly with >>>> pkg. >>>>     at the end of the run poudriere runs `pkg repo` to create the >>>>     meta files and sign the repo. It forks itself (ncpus + 2 I guess, >>>>     even forcing it to 1 worker I see three processes), and then >>>>     locks up, with all the processes stopping using CPU (ps output is >>>>     in my message) >>>>     I guess this can be reproduced with any poudriere repo with at >>>>     least more than ncpus packages in it. can also be reproduced >>>>     using `poudriere pkgclean -u ` >>>>     If that does not work I'm not sure how to reproduce it in other >>>>     ways, but I can try  writing some code mocking what pkg seems to >>>>     be doing, not an expert at such things, though. >>> >>>     In case it helps further norrow doen things, It looks like the >>>     lockup is happening somewhere around here: >>> >>> >>> https://github.com/freebsd/pkg/blob/56fa3f87d9d9644348b89680dfd8af47a860ee82/libpkg/pkg_repo_create.c#L778 >>> >>>     and/or in the pkg_create_repo_worker() function here: >>> >>> >>> https://github.com/freebsd/pkg/blob/56fa3f87d9d9644348b89680dfd8af47a860ee82/libpkg/pkg_repo_create.c#L341 >>> >>> >>>     (I'm trying to spare you the time needed to find the actual code >>>     being executed, I guess you would have identified this in a few >>>     minutes yourself, but I'm trying to make myself useful) >> >> >>     There appears to be a GitHub issue for poudriere with this, but >>     seems to be looking in another direction. >> >>     https://github.com/freebsd/poudriere/issues/1009 >>     >> > > This one looks quite similar. > > In my case the ports/pkg are aligned between host and jail, in fact I > have built them from the exact same git checkout. > > I noticed pkg head has been converted to using pthreads instead of fork, > maybe that could help. I will make time to perform some testing. Thanks for pointing me here, it looks like this was "it", in that by fixing this issue it uses native pkg-static, and sidesteps the issue. Unluckily there ARE qemu races and lockups that prevent arm64 pkg-static binary to be correctly emulated by qemu-user-static. such conditions also cause sporadic failures in some ports being built. I filed a PR with a fix for that issue: https://github.com/freebsd/poudriere/pull/1115 -- Guido Falsi From nobody Mon Jan 29 15:53:54 2024 X-Original-To: emulation@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TNtC42p1Yz58wpQ for ; Mon, 29 Jan 2024 15:54:08 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-lj1-x236.google.com (mail-lj1-x236.google.com [IPv6:2a00:1450:4864:20::236]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4TNtC40S36z4jl1 for ; Mon, 29 Jan 2024 15:54:08 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-lj1-x236.google.com with SMTP id 38308e7fff4ca-2cf1288097aso39308861fa.0 for ; Mon, 29 Jan 2024 07:54:07 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20230601.gappssmtp.com; s=20230601; t=1706543646; x=1707148446; darn=freebsd.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=cgy2daOrsxJC1nya0nGFzmIpH3kAc4FKzE49H4TN5L4=; b=teBLXGau8bpHnf+D0VBPDYyl4PEiFPRzzcBLUNYtftWo1vQJ8aoslaSEJHm5b1vGM4 K2j0M7lRsVCVjTEj6kDtsW37NhXcdJCpC6LpvOxfeQx+cnnzyplm76Q64zCQDD3adI2C fOuGWtpcN7/5T+yygbVPVVZXLjm6DxvbxL/nkAAz+h/L+ltozCkWWh01OixfkIz2KQ+A 1ejfmksulBc7/pXEBCUsIVN0b/GZPetJDkS21v2BgEOFBOqVFvBlNSWHgofgtvzYBBUt DGxLAP1DIuYF0MudJxURd8NcdrcQ5BtRJy0si2ESUv/msBGuLmQqXKYOSV4FzucyFAt3 OBTQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1706543646; x=1707148446; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=cgy2daOrsxJC1nya0nGFzmIpH3kAc4FKzE49H4TN5L4=; b=wZoQwSk7HxZYpG02283CT5mvFO0Yi/Mhe+PM83RfmTHg1m+RYP6i1ML41UTf8CEurV vGlXWmkbuSop7NxkXS7Oe1coUvp6zdVntcwHmnIB/AIj1yj3zrjiUMi3hQ58/rjfrqvA bYW32Z8w9A4euGooaWA8IbmprmfS9oWIr3G16OgmSAewQoEB8UxbbAGyFmtzY/VMt3bT jYANBVlkJNSxuQZh3GrRRtmL47RrxUk3lRRLTrNBrsUsVqKUDhbRBv9aJy5c9u9WviSM 8I/9rBZCkIW5NUf6265kPeGsp0Oxsj4waZAzhBraFYos1ZFKp6hIoE8NbWbJR5krdA2a /PvA== X-Gm-Message-State: AOJu0YxSRMFtkWWaPQCkhQkovUg/l42Nxta40OcLrzhBoqm8bp5fpc2b CZb4DFwIxlNwYKDT5wLBTJ59vCAqAg5k5RSwrkfX58BLHrigX5v7Tpu9eTC5b/iLst/jeJLTUJ2 UqQloontak7mvuCu8iyA9ar/fUrCQE+0ZtV9ecw== X-Google-Smtp-Source: AGHT+IHPSB8BNFNYJyhbhkJA6dXtNMaykIiwsTDPqDl4BOQMLhKj/DEZnIZ5jM7ppMd6V5zboA5TVDRB6QdZbm6LPqc= X-Received: by 2002:a2e:855a:0:b0:2cd:936d:1009 with SMTP id u26-20020a2e855a000000b002cd936d1009mr3969138ljj.19.1706543645807; Mon, 29 Jan 2024 07:54:05 -0800 (PST) List-Id: Development of Emulators of other operating systems List-Archive: https://lists.freebsd.org/archives/freebsd-emulation List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-emulation@freebsd.org MIME-Version: 1.0 References: <6a33726b-eb6f-418e-9fbd-6d0b9b4bfaa8@madpilot.net> <0fc7f929-6e5b-4a33-97d2-8a9c0c07d524@madpilot.net> <79a5eb0f-d04e-4c1a-9d8a-185e1fb4e4a2@madpilot.net> <5ef2ab66-25ef-45f1-aa5a-4b614eab2f40@madpilot.net> <990427ae-0491-463e-92c7-c74700deb6fa@madpilot.net> In-Reply-To: <990427ae-0491-463e-92c7-c74700deb6fa@madpilot.net> From: Warner Losh Date: Mon, 29 Jan 2024 08:53:54 -0700 Message-ID: Subject: Re: qemu-user-static aarch64 lockup/race? (was Re: Python failure in poudriere on arm64 (via qemu-user-static cross compiling)) To: Guido Falsi Cc: Nathan Reilly-list , emulation@freebsd.org, "freebsd-arm@freebsd.org" , freebsd-pkg@freebsd.org Content-Type: multipart/alternative; boundary="000000000000cd7156061017a743" X-Rspamd-Queue-Id: 4TNtC40S36z4jl1 X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] --000000000000cd7156061017a743 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Mon, Jan 29, 2024, 8:48=E2=80=AFAM Guido Falsi wrote: > On 29/01/24 09:26, Guido Falsi wrote: > > On 29/01/24 02:10, Warner Losh wrote: > >> > >> > >> On Sun, Jan 28, 2024 at 4:45=E2=80=AFPM Nathan Reilly-list >> > wrote: > >> > >> > >> > >>> On 29 Jan 2024, at 8:43=E2=80=AFam, Guido Falsi >>> > wrote: > >>> On 28/01/24 22:34, Guido Falsi wrote: > >>>> On 28/01/24 22:23, Warner Losh wrote: > >>>>> On Sun, Jan 28, 2024, 12:38=E2=80=AFPM Guido Falsi >>>>> >>>>> >> wrote: > >>>>> > >>>>> On 28/01/24 15:15, Guido Falsi wrote: > >>>>> [snip] > >>>>> > Creating repository in /tmp/packages: 0% > >>>>> > > >>>>> > >>>>> BTW, forgot to mention last time this worked without issue > >>>>> was around > >>>>> 20th December. > >>>>> > >>>>> > >>>>> I think this is a bsd-user issue. There is a race somewhere in > >>>>> that code that causes the hangs. I'd love a reproducible test > >>>>> case that is somewhat smaller than python... there are bigger > >>>>> races with the newer stuff and I've not had the time to chase i= t > >>>>> there either. =F0=9F=98=9E > >>>> First of all thanks for your feedback. It encourages me having > >>>> someone else with better knowledge about this confirm that a rac= e > >>>> condition is actually a possible cause! > >>>> Strange this has not been happening up to mid December. > >>>> My main and fully reproducible use case is actually mostly with > >>>> pkg. > >>>> at the end of the run poudriere runs `pkg repo` to create the > >>>> meta files and sign the repo. It forks itself (ncpus + 2 I guess= , > >>>> even forcing it to 1 worker I see three processes), and then > >>>> locks up, with all the processes stopping using CPU (ps output i= s > >>>> in my message) > >>>> I guess this can be reproduced with any poudriere repo with at > >>>> least more than ncpus packages in it. can also be reproduced > >>>> using `poudriere pkgclean -u ` > >>>> If that does not work I'm not sure how to reproduce it in other > >>>> ways, but I can try writing some code mocking what pkg seems to > >>>> be doing, not an expert at such things, though. > >>> > >>> In case it helps further norrow doen things, It looks like the > >>> lockup is happening somewhere around here: > >>> > >>> > >>> > https://github.com/freebsd/pkg/blob/56fa3f87d9d9644348b89680dfd8af47a860e= e82/libpkg/pkg_repo_create.c#L778 > < > https://github.com/freebsd/pkg/blob/56fa3f87d9d9644348b89680dfd8af47a860e= e82/libpkg/pkg_repo_create.c#L778 > > > >>> > >>> and/or in the pkg_create_repo_worker() function here: > >>> > >>> > >>> > https://github.com/freebsd/pkg/blob/56fa3f87d9d9644348b89680dfd8af47a860e= e82/libpkg/pkg_repo_create.c#L341 > < > https://github.com/freebsd/pkg/blob/56fa3f87d9d9644348b89680dfd8af47a860e= e82/libpkg/pkg_repo_create.c#L341 > > > >>> > >>> > >>> (I'm trying to spare you the time needed to find the actual code > >>> being executed, I guess you would have identified this in a few > >>> minutes yourself, but I'm trying to make myself useful) > >> > >> > >> There appears to be a GitHub issue for poudriere with this, but > >> seems to be looking in another direction. > >> > >> https://github.com/freebsd/poudriere/issues/1009 > >> > >> > > > > This one looks quite similar. > > > > In my case the ports/pkg are aligned between host and jail, in fact I > > have built them from the exact same git checkout. > > > > I noticed pkg head has been converted to using pthreads instead of fork= , > > maybe that could help. I will make time to perform some testing. > > Thanks for pointing me here, it looks like this was "it", in that by > fixing this issue it uses native pkg-static, and sidesteps the issue. > > > Unluckily there ARE qemu races and lockups that prevent arm64 pkg-static > binary to be correctly emulated by qemu-user-static. such conditions > also cause sporadic failures in some ports being built. > > I filed a PR with a fix for that issue: > > https://github.com/freebsd/poudriere/pull/1115 Ok. This dodges the problem. But it papers over things. Any chance you could give me the state of pkg before + the package added as a test case for qemu? Warner > > -- > Guido Falsi > > --000000000000cd7156061017a743 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


On Mon, Jan 29, 2024, 8:48=E2=80=AFAM Guido Falsi <= mad@madpilot.net> wrote:
On 29/01/24 09:26, Guido Falsi wrote:
> On 29/01/24 02:10, Warner Losh wrote:
>>
>>
>> On Sun, Jan 28, 2024 at 4:45=E2=80=AFPM Nathan Reilly-list <list= s@nreilly.com
>> <mailto:lists@nreilly.com>> wrote:
>>
>>
>>
>>> =C2=A0=C2=A0=C2=A0 On 29 Jan 2024, at 8:43=E2=80=AFam, Guido F= alsi <mad@madpilot.net
>>> =C2=A0=C2=A0=C2=A0 <mailto:mad@madpilot.net>> wrote= :
>>> =C2=A0=C2=A0=C2=A0 On 28/01/24 22:34, Guido Falsi wrote:
>>>> =C2=A0=C2=A0=C2=A0 On 28/01/24 22:23, Warner Losh wrote: >>>>> =C2=A0=C2=A0=C2=A0 On Sun, Jan 28, 2024, 12:38=E2=80= =AFPM Guido Falsi <mad@madpilot.net
>>>>> =C2=A0=C2=A0=C2=A0 <mailto:mad@madpilot.net> &= lt;mailto:mad@madpilot.net
>>>>> =C2=A0=C2=A0=C2=A0 <mailto:mad@madpilot.net>&g= t;> wrote:
>>>>>
>>>>> =C2=A0=C2=A0=C2=A0 =C2=A0=C2=A0=C2=A0 On 28/01/24 15:1= 5, Guido Falsi wrote:
>>>>> =C2=A0=C2=A0=C2=A0 =C2=A0 =C2=A0 [snip]
>>>>> =C2=A0=C2=A0=C2=A0 =C2=A0=C2=A0=C2=A0=C2=A0 > Creat= ing repository in /tmp/packages:=C2=A0=C2=A0 0%
>>>>> =C2=A0=C2=A0=C2=A0 =C2=A0=C2=A0=C2=A0=C2=A0 >
>>>>>
>>>>> =C2=A0=C2=A0=C2=A0 =C2=A0=C2=A0=C2=A0 BTW, forgot to m= ention last time this worked without issue
>>>>> =C2=A0=C2=A0=C2=A0 was around
>>>>> =C2=A0=C2=A0=C2=A0 =C2=A0=C2=A0=C2=A0 20th December. >>>>>
>>>>>
>>>>> =C2=A0=C2=A0=C2=A0 I think this is a bsd-user issue. T= here is a race somewhere in
>>>>> =C2=A0=C2=A0=C2=A0 that code that causes the hangs. I&= #39;d love a reproducible test
>>>>> =C2=A0=C2=A0=C2=A0 case that is somewhat smaller than = python... there are bigger
>>>>> =C2=A0=C2=A0=C2=A0 races with the newer stuff and I= 9;ve not had the time to chase it
>>>>> =C2=A0=C2=A0=C2=A0 there either. =F0=9F=98=9E
>>>> =C2=A0=C2=A0=C2=A0 First of all thanks for your feedback. = It encourages me having
>>>> =C2=A0=C2=A0=C2=A0 someone else with better knowledge abou= t this confirm that a race
>>>> =C2=A0=C2=A0=C2=A0 condition is actually a possible cause!=
>>>> =C2=A0=C2=A0=C2=A0 Strange this has not been happening up = to mid December.
>>>> =C2=A0=C2=A0=C2=A0 My main and fully reproducible use case= is actually mostly with
>>>> pkg.
>>>> =C2=A0=C2=A0=C2=A0 at the end of the run poudriere runs `p= kg repo` to create the
>>>> =C2=A0=C2=A0=C2=A0 meta files and sign the repo. It forks = itself (ncpus + 2 I guess,
>>>> =C2=A0=C2=A0=C2=A0 even forcing it to 1 worker I see three= processes), and then
>>>> =C2=A0=C2=A0=C2=A0 locks up, with all the processes stoppi= ng using CPU (ps output is
>>>> =C2=A0=C2=A0=C2=A0 in my message)
>>>> =C2=A0=C2=A0=C2=A0 I guess this can be reproduced with any= poudriere repo with at
>>>> =C2=A0=C2=A0=C2=A0 least more than ncpus packages in it. c= an also be reproduced
>>>> =C2=A0=C2=A0=C2=A0 using `poudriere pkgclean -u <etc>= ;`
>>>> =C2=A0=C2=A0=C2=A0 If that does not work I'm not sure = how to reproduce it in other
>>>> =C2=A0=C2=A0=C2=A0 ways, but I can try=C2=A0 writing some = code mocking what pkg seems to
>>>> =C2=A0=C2=A0=C2=A0 be doing, not an expert at such things,= though.
>>>
>>> =C2=A0=C2=A0=C2=A0 In case it helps further norrow doen things= , It looks like the
>>> =C2=A0=C2=A0=C2=A0 lockup is happening somewhere around here:<= br> >>>
>>>=C2=A0 =C2=A0 =C2=A0
>>> https://github.com/freebsd/pkg/blob/56fa3f87d= 9d9644348b89680dfd8af47a860ee82/libpkg/pkg_repo_create.c#L778 <https://github.com/freebsd/pkg/blob/56fa3f87d9d9644348b89680dfd= 8af47a860ee82/libpkg/pkg_repo_create.c#L778>
>>>
>>> =C2=A0=C2=A0=C2=A0 and/or in the pkg_create_repo_worker() func= tion here:
>>>
>>>=C2=A0 =C2=A0 =C2=A0
>>> https://github.com/freebsd/pkg/blob/56fa3f87d= 9d9644348b89680dfd8af47a860ee82/libpkg/pkg_repo_create.c#L341 <https://github.com/freebsd/pkg/blob/56fa3f87d9d9644348b89680dfd= 8af47a860ee82/libpkg/pkg_repo_create.c#L341>
>>>
>>>
>>> =C2=A0=C2=A0=C2=A0 (I'm trying to spare you the time neede= d to find the actual code
>>> =C2=A0=C2=A0=C2=A0 being executed, I guess you would have iden= tified this in a few
>>> =C2=A0=C2=A0=C2=A0 minutes yourself, but I'm trying to mak= e myself useful)
>>
>>
>> =C2=A0=C2=A0=C2=A0 There appears to be a GitHub issue for poudrier= e=C2=A0with this, but
>> =C2=A0=C2=A0=C2=A0 seems to be looking in another direction.
>>
>> =C2=A0=C2=A0=C2=A0 https://githu= b.com/freebsd/poudriere/issues/1009
>> =C2=A0=C2=A0=C2=A0 <https://g= ithub.com/freebsd/poudriere/issues/1009>
>>
>
> This one looks quite similar.
>
> In my case the ports/pkg are aligned between host and jail, in fact I =
> have built them from the exact same git checkout.
>
> I noticed pkg head has been converted to using pthreads instead of for= k,
> maybe that could help. I will make time to perform some testing.

Thanks for pointing me here, it looks like this was "it", in that= by
fixing this issue it uses native pkg-static, and sidesteps the issue.


Unluckily there ARE qemu races and lockups that prevent arm64 pkg-static binary to be correctly emulated by qemu-user-static. such conditions
also cause sporadic failures in some ports being built.

I filed a PR with a fix for that issue:

https://github.com/freebsd/poudriere/pull/1= 115

Ok. This dodges the problem. But it papers over things.

Any chance you could give me the state o= f pkg before + the package added as a test case for qemu?

Warner

<= div dir=3D"auto">
=

--
Guido Falsi <mad@madpilot.net>

--000000000000cd7156061017a743-- From nobody Mon Jan 29 16:02:36 2024 X-Original-To: emulation@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TNtP15vWYz58xpc; Mon, 29 Jan 2024 16:02:45 +0000 (UTC) (envelope-from mad@madpilot.net) Received: from mail.madpilot.net (vogon.madpilot.net [159.69.1.99]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4TNtP14PvFz4m60; Mon, 29 Jan 2024 16:02:45 +0000 (UTC) (envelope-from mad@madpilot.net) Authentication-Results: mx1.freebsd.org; none Received: from mail (mail [IPv6:fd5c:5351:d272::3]) by mail.madpilot.net (Postfix) with ESMTP id 4TNtNv521gz6dPZ; Mon, 29 Jan 2024 17:02:39 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=madpilot.net; h= content-transfer-encoding:content-type:content-type:in-reply-to :from:from:references:content-language:subject:subject:date:date :message-id:received; s=bjowvop61wgh; t=1706544157; x= 1708358558; bh=LAcRqEj5uYV1Yn4tNfN3RryBSlrFsTskSWksyv4mxdY=; b=M 1/TJn8MVNEQSaygi5t1Xq1BtRg/P5Gk+wP02+9n6w0M9bi/07BKIX675QPo8bn7v N6A1zPdQEsIOtgYYwLelrB6KvYuxEFQeJpJTY6geOLtn+qz7IEQD/PNvhJnFNpr9 KyDJyNSGk+RkhepWnW5o36vNmfLy+MClXFI83M1mmAqjNA3z6yz/k+oGqGqh6JR8 L8E/qsawjXQJFrwiJgDVODYqxb/x9s5KT4W+wQSKvNxOzLm2DeYqkdZ3tBzeMdSk WFt/TMe7quJBgdoVsWWhgeNJC1kgzCiZn9xYs763quOMPrYlexwZYMtCn4QFE0wD Oc84uPvW36S01HMh3x6GA== Received: from mail.madpilot.net ([IPv6:fd5c:5351:d272::3]) by mail (mail.madpilot.net [IPv6:fd5c:5351:d272::3]) (amavisd-new, port 10026) with ESMTP id 8uxFb8pTTZtb; Mon, 29 Jan 2024 17:02:37 +0100 (CET) Message-ID: <8fc35459-c85e-417c-8b6c-de08cf9907a9@madpilot.net> Date: Mon, 29 Jan 2024 17:02:36 +0100 Subject: Re: qemu-user-static aarch64 lockup/race? (was Re: Python failure in poudriere on arm64 (via qemu-user-static cross compiling)) Content-Language: en-US, it To: Warner Losh Cc: Nathan Reilly-list , emulation@freebsd.org, "freebsd-arm@freebsd.org" , freebsd-pkg@freebsd.org References: <6a33726b-eb6f-418e-9fbd-6d0b9b4bfaa8@madpilot.net> <0fc7f929-6e5b-4a33-97d2-8a9c0c07d524@madpilot.net> <79a5eb0f-d04e-4c1a-9d8a-185e1fb4e4a2@madpilot.net> <5ef2ab66-25ef-45f1-aa5a-4b614eab2f40@madpilot.net> <990427ae-0491-463e-92c7-c74700deb6fa@madpilot.net> From: Guido Falsi Autocrypt: addr=mad@madpilot.net; keydata= xsBNBE+G+l0BCADi/WBQ0aRJfnE7LBPsM0G3m/m3Yx7OPu4iYFvS84xawmRHtCNjWIntsxuX fptkmEo3Rsw816WUrek8dxoUAYdHd+EcpBcnnDzfDH5LW/TZ4gbrFezrHPdRp7wdxi23GN80 qPwHEwXuF0X4Wy5V0OO8B6VT/nA0ADYnBDhXS52HGIJ/GCUjgqJn+phDTdCFLvrSFdmgx4Wl c0W5Z1p5cmDF9l8L/hc959AeyNf7I9dXnjekGM9gVv7UDUYzCifR3U8T0fnfdMmS8NeI9NC+ wuREpRO4lKOkTnj9TtQJRiptlhcHQiAlG1cFqs7EQo57Tqq6cxD1FycZJLuC32bGbgalABEB AAHNHkd1aWRvIEZhbHNpIDxtYWRAbWFkcGlsb3QubmV0PsLAeQQTAQgAIwIbAwIeAQIXgAUL CQgHAwUVCgkICwQWAgMBBQJS79AgAhkBAAoJEBrmhg5Wy9KTc0kH/RO64ORBlTbTHaUaOj8F Je5O5NU2Pt9Cyt5ZWBRvxntr1zPTJGKRPS9ihlIfqT4ZvEngQGp57EUyFbCpI0UWasTerImM tt5WACnGmCzUTB39UXx8Oy4b1EgWeTJQ747e/F1mQLXTNa6ijRBE9fYlTb4gAkPN88/wVV9v 3PZozKLTg16ghBzHM/P7Lk8L7clPEZChX1FTa/6eSt3nvzfCuTMZbBPJF/ph+q1KyPqRgVfh tyhu5dvgMoPz/ni41IfeSrkJTD5RXzdyGR9q4Z1NYeBsLkRjC4LxKAP5KqUsvlOUjKvO1byj ApYdMarol+IGkaSk9e3zVYAJkWKjn/ni8XbOwU0EUxB7QQEQAKFhrDceoPdK/IHDSmoj6SQY isvM7VdhcleS7E9DoEAVt7yMbf6HbbMVTTY6ckvwTWQssywLBXNVqxgc4WLJjzfUhgef+WE7 5M3+WFYlOVQLGZY/zEVgma1raYnOHNAOzeHLDmEXjbZP6vGAeDyBbGfQPpE7qGYZ7ubeT3Xw QO+PklcCrvOPj2ZPcAxGNS2xVU/LzONqCrJqLMJSIcCdsbiSP4G5PnDFHtMokaTY6OEr8OEQ fOAerhcHUa/z7Uu8YtmaqKH+QGkE/WEgaRqSiTnv0JOTD+DxehaqvoKPPZ++2NpCZMHB2i6A /xifmQwEiIjEXtcueBRzkNUQkxhqZyS13SrhocL9ydtaVPBzZatAEjUDDEJmAMLVFs45qfyh MiNapHJo2n3MW/E5omqCvEkDdWX/en3P7CK2TemeaDghMsgkNKax/z0wNo5UZCkOPOz0xpNi UilOVbkuezZZNg65741qee2lfXhQIaZ66yT7hphc/N/z3PIAtLeze4u1VR2EXAuZ2sWAdlKC NTlJMsaU/x70BV11Wd/ypnVzM68dfdQIIAj1iMFAD/lXGlEUmKXg5Ov2VQDlTntQoanCYrAg +8CttPzjrydgLZFq3hrtQmfc0se5yv1WHS69+BsUOG09RvvawUDZxUjW19kyeN9THaNRgow3 kSuArUp6zSmJABEBAAHCwF8EGAEIAAkFAlMQe0ECGwwACgkQGuaGDlbL0pMN5wgA4bCkX/qw EVC06ToeR6C2putmSWQMgpDaqrv65Hubo+QGmg2P4ewTYQQ4g6oYWS03qHxqVVWhKz7FjfrV +dH8qbCLfSgIcvdBha7ayGZVrsiuMLKGbw36fcmkZPpSDOfHcP0XH8Z+u9CWj0xUkTxAlZ/7 i6gYSUpG2JWNtdmE/X8VVEyXusCLwy0K0BI60A/4dRTIX3C4QKrJ3ZbUXegz70ynjHf+lQMZ 9IZKASoRMuS5FozPQh6abvmwZEPdf5I9riUElzvHrqJ8Bx0t3Pujdoth+yNHpnBxrtO8LkQd rQ58P0SwcaIX33T2U9pG8bhu5YVR88FQ8OQ0cEsPBpDncg== In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 4TNtP14PvFz4m60 X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:24940, ipnet:159.69.0.0/16, country:DE] List-Id: Development of Emulators of other operating systems List-Archive: https://lists.freebsd.org/archives/freebsd-emulation List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-emulation@freebsd.org On 29/01/24 16:53, Warner Losh wrote: > > > On Mon, Jan 29, 2024, 8:48 AM Guido Falsi > wrote: > > On 29/01/24 09:26, Guido Falsi wrote: > > On 29/01/24 02:10, Warner Losh wrote: > >> > >> > >> On Sun, Jan 28, 2024 at 4:45 PM Nathan Reilly-list > > >> >> wrote: > >> > >> > >> > >>>     On 29 Jan 2024, at 8:43 am, Guido Falsi > >>>     >> wrote: > >>>     On 28/01/24 22:34, Guido Falsi wrote: > >>>>     On 28/01/24 22:23, Warner Losh wrote: > >>>>>     On Sun, Jan 28, 2024, 12:38 PM Guido Falsi > > >>>>>     > > > >>>>>     >>> wrote: > >>>>> > >>>>>         On 28/01/24 15:15, Guido Falsi wrote: > >>>>>         [snip] > >>>>>          > Creating repository in /tmp/packages:   0% > >>>>>          > > >>>>> > >>>>>         BTW, forgot to mention last time this worked without > issue > >>>>>     was around > >>>>>         20th December. > >>>>> > >>>>> > >>>>>     I think this is a bsd-user issue. There is a race > somewhere in > >>>>>     that code that causes the hangs. I'd love a reproducible test > >>>>>     case that is somewhat smaller than python... there are bigger > >>>>>     races with the newer stuff and I've not had the time to > chase it > >>>>>     there either. 😞 > >>>>     First of all thanks for your feedback. It encourages me having > >>>>     someone else with better knowledge about this confirm that > a race > >>>>     condition is actually a possible cause! > >>>>     Strange this has not been happening up to mid December. > >>>>     My main and fully reproducible use case is actually mostly > with > >>>> pkg. > >>>>     at the end of the run poudriere runs `pkg repo` to create the > >>>>     meta files and sign the repo. It forks itself (ncpus + 2 I > guess, > >>>>     even forcing it to 1 worker I see three processes), and then > >>>>     locks up, with all the processes stopping using CPU (ps > output is > >>>>     in my message) > >>>>     I guess this can be reproduced with any poudriere repo with at > >>>>     least more than ncpus packages in it. can also be reproduced > >>>>     using `poudriere pkgclean -u ` > >>>>     If that does not work I'm not sure how to reproduce it in > other > >>>>     ways, but I can try  writing some code mocking what pkg > seems to > >>>>     be doing, not an expert at such things, though. > >>> > >>>     In case it helps further norrow doen things, It looks like the > >>>     lockup is happening somewhere around here: > >>> > >>> > >>> > https://github.com/freebsd/pkg/blob/56fa3f87d9d9644348b89680dfd8af47a860ee82/libpkg/pkg_repo_create.c#L778 > > >>> > >>>     and/or in the pkg_create_repo_worker() function here: > >>> > >>> > >>> > https://github.com/freebsd/pkg/blob/56fa3f87d9d9644348b89680dfd8af47a860ee82/libpkg/pkg_repo_create.c#L341 > > >>> > >>> > >>>     (I'm trying to spare you the time needed to find the actual > code > >>>     being executed, I guess you would have identified this in a few > >>>     minutes yourself, but I'm trying to make myself useful) > >> > >> > >>     There appears to be a GitHub issue for poudriere with this, but > >>     seems to be looking in another direction. > >> > >> https://github.com/freebsd/poudriere/issues/1009 > > >>     > > >> > > > > This one looks quite similar. > > > > In my case the ports/pkg are aligned between host and jail, in > fact I > > have built them from the exact same git checkout. > > > > I noticed pkg head has been converted to using pthreads instead > of fork, > > maybe that could help. I will make time to perform some testing. > > Thanks for pointing me here, it looks like this was "it", in that by > fixing this issue it uses native pkg-static, and sidesteps the issue. > > > Unluckily there ARE qemu races and lockups that prevent arm64 > pkg-static > binary to be correctly emulated by qemu-user-static. such conditions > also cause sporadic failures in some ports being built. > > I filed a PR with a fix for that issue: > > https://github.com/freebsd/poudriere/pull/1115 > > > > Ok. This dodges the problem. But it papers over things. Definitely, but this is actually also what was happening in the past. It stopped using native (host) pkg-static due to the pkg port gaining a PORTREVISION, which caused the same version check to fail. I agree the underlying issue should be fixed. > > Any chance you could give me the state of pkg before + the package added > as a test case for qemu? Not sure I understand what you are asking for, can you elaborate? What I did was run poudriere asking it to compile a few packages, the lockup, when trying to use target arch pkg-static via qemu-user, is reproducible 100% in my experience. It does not really depend on number of packages. I get it by starting with an empty build. I'm building these packages (and obviously their dependencies): dns/unbound net/kea sysutils/tmux (I guess building only tmux could suffice) With poudriere you can get it to use target arch pkg-static by modifying /usr/local/share/poudriere/common.sh function ensure_pkg_installed, making sure the check here fails: https://github.com/freebsd/poudriere/blob/e00503d846dc7a3b661aac84a6657f15e0f4b702/src/share/poudriere/common.sh#L5687 -- Guido Falsi From nobody Sun Feb 4 21:00:06 2024 X-Original-To: emulation@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TShjM4jKRz58nfG for ; Sun, 4 Feb 2024 21:00:07 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4TShjM0r6fz4J01 for ; Sun, 4 Feb 2024 21:00:07 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1707080407; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=U5c0qzI3YqKFbjnzOyuNxzbIyIOgX69onEHtj7E7D0Y=; b=PTqVGqyw8+dJwOKfv8FS/eg5I3Eu1gsyMC4RfuLUgn1t/CAnRG2PgNdmwunluUmPgMtjiK VtBYtGx9hKHspfJXHG5rXToVtOnshsgDRo8cGEYdb26ig1Ge/0DvQ4XNjrpMq525ds7Wv8 yZ9Y3hfQHH7UsTBItirqzbWbuZRXvbwFj0256S3n5B/HSpFucDN351sYe0SdszKbaG1R4H NEe3JJTHadCJCEFYyyw6D2EKqqnV8fJJ/1N6+r8t5YUwf8/uXa+7eKWz2UScaQQlxRmSx1 8IAZnu/xQ2tcMQR7dQJtaarUK3tMchavYhrmkV/e3v+lo5A4zcuoJJ1dsatUeA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1707080407; a=rsa-sha256; cv=none; b=ldvjrFCXxqL2vRQEuE0Zg6MzQxrXZJ8eMETSE7X3AKmktFuYcn57Uve16nWLlQJZsUM8+b XQy7FgqoZJS6RRkJCj3zynS/9FV/6F3x13Ab3kJjCC+1NNZ/DiT0hwHsMSTLAOp0xo9N7W QFM7LfFP56Gl0jw5qrERovMayBCu/hFoGiX55uHza2kUPH/M6g+HeeuIAg2GdIVlDRDL/C KeeJ44+dJ1Qf8x592vseNCXrmt6Gjj+ZYnJKTjpot+Zuy51n3eYmnGr7A02Xidll1PRf2K SY1aCFQCpbhRWL6DCC8C4mNpxHSaPfUET84RcYYg4NV+oyn86yylDq7BlkkPeQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4TShjL6zsbz1BV7 for ; Sun, 4 Feb 2024 21:00:06 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 414L065R027250 for ; Sun, 4 Feb 2024 21:00:06 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 414L069b027236 for emulation@FreeBSD.org; Sun, 4 Feb 2024 21:00:06 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202402042100.414L069b027236@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: emulation@FreeBSD.org Subject: Problem reports for emulation@FreeBSD.org that need special attention Date: Sun, 4 Feb 2024 21:00:06 +0000 List-Id: Development of Emulators of other operating systems List-Archive: https://lists.freebsd.org/archives/freebsd-emulation List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-emulation@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="17070804066.fC171.24290" Content-Transfer-Encoding: 7bit --17070804066.fC171.24290 Date: Sun, 4 Feb 2024 21:00:06 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 264835 | Linux: USB-IP tool fails to run: setsockopt - IP_ Open | 274330 | emulators/linux_base-c7: update package message New | 269934 | emulators/qemu-user-static does not support capab Open | 219913 | emulators/virtualbox-ose-kmod: if the MAXCPU opti 4 problems total for which you should take action. --17070804066.fC171.24290 Date: Sun, 4 Feb 2024 21:00:06 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    264835 | Linux: USB-IP tool fails to run: setsockopt - IP_
Open        |    274330 | emulators/linux_base-c7: update package message
New         |    269934 | emulators/qemu-user-static does not support capab
Open        |    219913 | emulators/virtualbox-ose-kmod: if the MAXCPU opti

4 problems total for which you should take action.
--17070804066.fC171.24290-- From nobody Sun Feb 4 21:53:00 2024 X-Original-To: emulation@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TSjtQ1rQzz58tYt for ; Sun, 4 Feb 2024 21:53:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4TSjtP6T8Pz4SlG for ; Sun, 4 Feb 2024 21:53:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1707083581; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=NCzKmzW4bJR7uj+6LN3+j+J1lQAKmO+SMS91gEYMI3Q=; b=whmnIEafYOsoNbbcRz5Am8efd1lyw9nDkcEgUTRQEudu8w/tTxrKdRMHI6l36NK9plhFug 5Jh5uv+Q3AD1/g3n7FUjgSu93nRg6X9zfaCYedCQBeGghEqOZgfroc657fRbW40C2vCA51 fhkuLT00x66BHYajhGowCB+XLCdxczE6/nhHTsz2r2H4qmRQJGMRxot2mh0eKzlTjEnz6n 0BAfg0ShN0MUwFxr8Ao4hi4Lv7kpRIvnoQCiquEmNdqO/P+JVwCC1uu/A0oLJDVZVw4AN+ phZ3uzaHAhcQ/sZ/d0sGQF7N9qL0tCjeG9n03nKTCe9zC1Fyfy/Y5/WBwIm+Cg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1707083581; a=rsa-sha256; cv=none; b=suHSI2x5wzlkBO66BtBI7VctCQfr6xj8mg8L0qRyajeD+qWsjGAfhLRyNDd5PHkneGHCaU L5p7pCr0D8i47uxUXWTN1OqPRD0UOXoyEVMw5FybYitI+5PBu5zxIAZluOgkwj4lFPIa07 yLfPMyD7pacMVOcJPT10AGyyiBAPaf2bd4H3yVoFCQv4bj31hn1uieahJu+APipuhRDL8o mM0LbvErItrmKebde2pMF1kNZ3dTjdLZsukZzTMKvRYzBOn8LGLqMfHkBh/fBh18oMuGGM XiNclf8BJ/Uidv7Mf2JFvAIxmhFOf5gyhWt4XZCZ4Yo2w/Hr0EcwjUwwANwTXQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4TSjtP5Z0PzDcL for ; Sun, 4 Feb 2024 21:53:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 414Lr1MS002105 for ; Sun, 4 Feb 2024 21:53:01 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 414Lr1YY002104 for emulation@FreeBSD.org; Sun, 4 Feb 2024 21:53:01 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: emulation@FreeBSD.org Subject: [Bug 270900] emulators/virtualbox-ose USB passthrough fails with Failed to create a proxy device for the USB device. (Error: VERR_INVALID_PARAMETER) Date: Sun, 04 Feb 2024 21:53:00 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Ports & Packages X-Bugzilla-Component: Individual Port(s) X-Bugzilla-Version: Latest X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: bsd@itglob.ru X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: vbox@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: cc attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Development of Emulators of other operating systems List-Archive: https://lists.freebsd.org/archives/freebsd-emulation List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-emulation@freebsd.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D270900 Igor Malyshev changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |bsd@itglob.ru --- Comment #11 from Igor Malyshev --- Created attachment 248190 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D248190&action= =3Dedit USB passthrough fix after 9b077d72bcc313baea2b9283afc7f568739eaadc after 9b077d72bcc313baea2b9283afc7f568739eaadc this was changed - if (fs_ep_ptr =3D=3D NULL || ep_index_max > 127) + if (fs_ep_ptr =3D=3D NULL || ep_index_max > USB_FS_XFER_MAX) where USB_FS_XFER_MAX defined as 126 but in src/VBox/Devices/USB/freebsd/USBProxyDevice-freebsd.cpp USBFBSD_MAXENDPOINTS defined as 127 so change it to 126. patch attached. --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Sun Feb 4 23:19:19 2024 X-Original-To: emulation@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TSlp01Sc8z592gx for ; Sun, 4 Feb 2024 23:19:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4TSlnz73l0z4cXH for ; Sun, 4 Feb 2024 23:19:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1707088760; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=E61uMYJ59MBI0yhlyDTOj4G9prA6798n2zNANQqXPzA=; b=ji/guGkuVBvNjI9sRWYNtwMuuDQ7eyp3aPgSIfBIqeF+0z4Lztk2REZAOQ41JNmSfi8039 NiOe+b780HoTSTyk6jkvXE3DJgXt/dAO7jFRiOBzXzQRwLRTiPWNo4k0ed9V2DZ6cNea8K GnKyd/KXD5NOFmAb1wBzwdi3YHeLlqoxvFlXW/Oo3HlsMacOUzZBQnj8Tsps8gzQYrmfEV qkzCeZMD81C6UGG7B3+4TTGik1L2k8DxPFjeOmUuN9IhH/EqNJGHvaXnmUfoo2PVoHNNEs C91bRIaLLUZqr5WA1zxrBOy5097aE0KLACdxPC0+nWnqAJzaX75xRopAsvl0Wg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1707088760; a=rsa-sha256; cv=none; b=B9OX5njy+t4zxfs0SLx/GsBWxr4Hk5iT86Ic/AKCmOaSdapR8CRErsxOY52Ga9jOGH/pad a/ie965YNw+RQp7TAH4f0XPYXFd9fkxrwkTT7oShfzikNm3h2bF4mIzp09IwEsnvncznK2 ePJe06piJGNG6c9D/2/dc0+oFxuIliD6MLcHaLM4LMTBV7+p3UBOpMAaEvNTnnzVog4/8J B9CctgQWYvqsZxSH6z9PFG/d/fV827Je2onhSf7/ENP2751nEOBhBQf6mt/RmcMSejUwdr aavT6p9pRch+nouAsYJT0cAO7SbMHeB9CI8Mg2bbBJzIerJSFuOH+1UBrY3KWQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4TSlnz5vXdzHHr for ; Sun, 4 Feb 2024 23:19:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 414NJJkV027229 for ; Sun, 4 Feb 2024 23:19:19 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 414NJJGg027228 for emulation@FreeBSD.org; Sun, 4 Feb 2024 23:19:19 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: emulation@FreeBSD.org Subject: [Bug 247327] i386 linuxulator doesn't support more than one LDT Date: Sun, 04 Feb 2024 23:19:19 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: iwtcex@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: emulation@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Development of Emulators of other operating systems List-Archive: https://lists.freebsd.org/archives/freebsd-emulation List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-emulation@freebsd.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D247327 --- Comment #1 from Alex S --- Created attachment 248191 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D248191&action= =3Dedit comment cleanup I should probably use Phab instead, but, just in case I forget about it, he= re is a good-enough-for-me patch. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Feb 4 23:49:40 2024 X-Original-To: emulation@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TSmT14L6Kz595Ck for ; Sun, 4 Feb 2024 23:49:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4TSmT13CsHz4flM for ; Sun, 4 Feb 2024 23:49:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1707090581; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=XfDunZy4nq+lPeY4R2VXnFdFERPqRTnzsGRCwAENtq0=; b=GfGdcyQiKy7fAyTW8JDIwPlDXgnqah+XPWyngpl3UypMTMQD09jwcK+ZFuCKxy/E9OE0t9 mStX72Kc9AgULn2+yvfzoK1Sm1qMz7rBe3fwzhM3FJl2YCyUZhradnGHv8Zvbow9vR7GXU N9v+6FnynabC6UVY19keAp68w5U7ExQdT2YicJjw3NK74Fsm+88VIhZQEjKLzXleNHfUJh SrnPMoPF1R+C+ESn8pFs/AkIYL//bxk5S+Fe88g4rEN0+MBsAIh15PstFse7vf87NF2tvw FGS2uqyHqkgh51pdpftnoU4lUNiouqueYz4JKRm8CZ7DQOhy6m0wuQ4wK9wJrw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1707090581; a=rsa-sha256; cv=none; b=nrE7zi1TYmHQ14TZew7UH6YrXQD/+xCY2kRfp77J7cPrczXReyIs+SbwMEz1hi3MJf8H5Z 94i4ZFbIvtQdO+Ki8lW7QF9dMlBGG5BQXOjzLML/Q1QXYgt5fFxl2vAGVwcC7dBwReIAt7 8jXC2JMlchdXb4q+W4C7ivAdZH/Gtk02WQRkG0eGumsOZDI93jjJxHBZ5zv7Czja+tyJoz qq3HvL8Rr4fub9m+BFd1Uws/U/LXlhBC6cRtAndVUuYMYnWFaClNh25A737SOy2uqrqozv +IHP2FjS+TieK+LN9LcrvE9MmYJ1J+MXF9jiWmypY+iTl6bdjl3zkvihC7kqlQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4TSmT124ZhzHyl for ; Sun, 4 Feb 2024 23:49:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 414Nnf9m079151 for ; Sun, 4 Feb 2024 23:49:41 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 414Nnfpj079150 for emulation@FreeBSD.org; Sun, 4 Feb 2024 23:49:41 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: emulation@FreeBSD.org Subject: [Bug 270900] emulators/virtualbox-ose USB passthrough fails with Failed to create a proxy device for the USB device. (Error: VERR_INVALID_PARAMETER) Date: Sun, 04 Feb 2024 23:49:40 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Ports & Packages X-Bugzilla-Component: Individual Port(s) X-Bugzilla-Version: Latest X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: groenveld@acm.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: vbox@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Development of Emulators of other operating systems List-Archive: https://lists.freebsd.org/archives/freebsd-emulation List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-emulation@freebsd.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D270900 --- Comment #12 from groenveld@acm.org --- (In reply to Igor Malyshev from comment #11) Thank you. Tested on 14.0-RELEASE-p4 John groenveld@acm.org $ cat files/patch-src_VBox_Devices_USB_freebsd_USBProxyDevice-freebsd.cpp --- src/VBox/Devices/USB/freebsd/USBProxyDevice-freebsd.cpp.orig=20=20=20= =20=20=20=20 2024-01-11 12:23:15 UTC +++ src/VBox/Devices/USB/freebsd/USBProxyDevice-freebsd.cpp @@ -57,7 +57,7 @@ #include "../USBProxyDevice.h" /** Maximum endpoints supported. */ -#define USBFBSD_MAXENDPOINTS 127 +#define USBFBSD_MAXENDPOINTS 126 #define USBFBSD_MAXFRAMES 56 /** This really needs to be defined in vusb.h! */ --=20 You are receiving this mail because: You are on the CC list for the bug.=