From owner-freebsd-virtualization@freebsd.org Sun Mar 28 19:56:38 2021 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8A2DE5AC62C for ; Sun, 28 Mar 2021 19:56:38 +0000 (UTC) (envelope-from infoomatic@gmx.at) Received: from mout.gmx.net (mout.gmx.net [212.227.17.20]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mout.gmx.net", Issuer "TeleSec ServerPass Class 2 CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F7mgT53TDz3JFd for ; Sun, 28 Mar 2021 19:56:37 +0000 (UTC) (envelope-from infoomatic@gmx.at) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=gmx.net; s=badeba3b8450; t=1616961396; bh=HKVCfj/nR2P6OwiQHcQTgcUqRr44Hi38v48HpTBbnOE=; h=X-UI-Sender-Class:To:From:Subject:Date; b=DWHEHvzoiZKaSaMkZhUHOaWUD0iG0JLKCkQtEn1Mmb0in+WOHMdMn1Uol1v4hFCBm MyYNUEYYDpOWg3ka3ByZ1VXpSMBi5VaXahl47WplAw8Iut8LI/OnGzlfDzzboHB8Uu tmRjLbvTf3N2GowlcEespGWa1zdRsDYYlb8onwgM= X-UI-Sender-Class: 01bb95c1-4bf8-414a-932a-4f6e2808ef9c Received: from [10.0.1.209] ([178.114.229.50]) by mail.gmx.net (mrgmx105 [212.227.17.168]) with ESMTPSA (Nemesis) id 1MCsUC-1lHq553kIa-008vl4 for ; Sun, 28 Mar 2021 21:56:35 +0200 To: freebsd-virtualization@freebsd.org From: infoomatic Subject: bhyve iommu passthru ath0 Message-ID: <275fb099-a036-05fc-bd1f-706e1d01ff98@gmx.at> Date: Sun, 28 Mar 2021 21:56:35 +0200 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:78.0) Gecko/20100101 Thunderbird/78.9.0 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Content-Language: en-US X-Provags-ID: V03:K1:+ba3oJQ+lxRWW1nq0kgUZKugoBiN8ULc3+ATw7+lc1XCsCTusCp ibHaZMe3tKp39AlbACgN5lqbPvINTvx3b9mpkZaO5m8gYSebh827kAYIA9BdK1yCKwKRdRA IY2ZQ+dCs51vba0pnPqM33JK10Ohj3peKaxCpBvh7YIz0oQygiyZ2QlygRvogeaivHHVp+T tu4TMl1aIq686V2gvlFVg== X-Spam-Flag: NO X-UI-Out-Filterresults: notjunk:1;V03:K0:365084De59s=:atHzWBPI8nC3GGOnGyoJep 2HTW2oaIvSLVdacMySQwXKslYYsHI5mjAbBLKB42xVinldLsUCFRWZmIWMyJezTeknR8/o37g WBXWwJ5o6HwhJD3dxGHNFLLD2LGp41AqEFFFrKLS7hp7h75wITiVH7tqwYFCNl159+718MF1H hw02neRpZrNmAjRNcwcFBq/r390rIwNBWmdxjx5VeLhcZ2/2ekhSZ3gaq2o8mbOcb0u4LJsRJ lrNeXLczPkGcLOCnsdSota0szX6lrTAY2SUSKdfpU+pw7DOmdoEk3p4qwrkXzKfdvwl9Pfb6v zd0YICa9cWROSU+wiemi6AfjQZhTxB+7EwXCeUldiUzY7HINy44OO07U8DA4tK8EQ6dMbyq0/ c/wYOLTBGiZygBEvR+bCV8h5ikyWpSit245c0UHHNIbA0ocUna97LXxPD7gizm/zOJSk+xzp/ UIYQq+tJYs/v8m8QZdfHkObYOjnru3oOFPTg6aUfAHr0/t9F+J8xGPwthlD2CY/HIaTBdS2kY K/KOIEouDxGIfzPIfhW29tUVdW8C47w4EKer+6YZEQ+UEaBwkzMG8EWnrfMO+hUq2mq/tdlGA kYT6XVuqqrm8EcOLzBUTUWxMf61OkTlWkQRn44rpKM6lysYUoNIwxxdy1XcNLR9ok4iCrNiu9 o60xkZWhlob4NLgQLa8k3uQSM9WP3tDtM4YHD6sMD+38Rh7pAZHYPNmKc2tyNGpHDL7UtBSDA uBMBVYy4+EvzdOpNFfIJHY013f/uPK5Tu9t6bWJUaLK6kDp775qEuzxeOdfFjdJ88/TpsA7hX 3pCBkvDZfiwMGAAEdlGwhvaW/E2UUe44XMfbLbqPk9/qpK12CaiOhOMGFnDdG3EZ54XEQ977w iQlcgubbi0IgA+zCd1xZ1upqLpC5U2QxjvkVh8XaDehPmZAQ29ly5r9z/w2JF9FZeUnfO4lvu CXnoOcrG3wClCbiYojP8jRp2vB6AjkGSfiLtevmz9OKiYLv7ot/ApkC3Er/84YOPBZF5TksoH jPDvbo2EOsyLDW8XqsTkzq2Z26oG5N2nNPsAnLpTatbP9PARLB4pcxqETJ/CopdwBZrlcuBS5 6rLorNHtdAfQ6BBX6w6MoZpax1bCt2D/GFDXbGw3x0XfKGHqV5pVFGbH5dlEfOHeRP8ipfvMH si01pfG4m8BOl/9ExVl4wJ0EMAMQHfJRb1mlH2+q0IcxcbrcG63c4DnNobbNA1JbwhCO4= X-Rspamd-Queue-Id: 4F7mgT53TDz3JFd X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmx.net header.s=badeba3b8450 header.b=DWHEHvzo; dmarc=pass (policy=none) header.from=gmx.at; spf=pass (mx1.freebsd.org: domain of infoomatic@gmx.at designates 212.227.17.20 as permitted sender) smtp.mailfrom=infoomatic@gmx.at X-Spamd-Result: default: False [-4.10 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; FREEMAIL_FROM(0.00)[gmx.at]; R_SPF_ALLOW(-0.20)[+ip4:212.227.17.0/27]; TO_DN_NONE(0.00)[]; DKIM_TRACE(0.00)[gmx.net:+]; DMARC_POLICY_ALLOW(-0.50)[gmx.at,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RCVD_IN_DNSWL_LOW(-0.10)[212.227.17.20:from]; FROM_EQ_ENVFROM(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[212.227.17.20:from]; FREEMAIL_ENVFROM(0.00)[gmx.at]; MID_RHS_MATCH_FROM(0.00)[]; ASN(0.00)[asn:8560, ipnet:212.227.0.0/16, country:DE]; MIME_TRACE(0.00)[0:+]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[gmx.net:s=badeba3b8450]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[212.227.17.20:from:127.0.2.255]; RWL_MAILSPIKE_POSSIBLE(0.00)[212.227.17.20:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-virtualization] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 28 Mar 2021 19:56:38 -0000 Hi all, I own a pcengines apu2e4 where bhyve passthru is working in general. Passing through the i210AT NICs works fine. However, I bought a Compex WLE200NX a/b/g/n miniPCI card which is based on the Qualcomm Atheros AR9280 chip I also want to pass through. On the host I am running 12.2-RELEASE-p5. my loader.conf: hw.vmm.amdvi.enable=3D1 vmm_load=3D"YES" pptdevs=3D"1/0/0 3/0/0 4/0/0" hw.vmm.iommu.enable=3D1 pciconf -lv gives (relevant info; with igb0 used on the host): ppt0@pci0:1:0:0:=C2=A0=C2=A0=C2=A0 class=3D0x028000 card=3D0x3099168c chip= =3D0x002a168c rev=3D0x01 hdr=3D0x00 =C2=A0=C2=A0=C2=A0 vendor=C2=A0=C2=A0=C2=A0=C2=A0 =3D 'Qualcomm Atheros' =C2=A0=C2=A0=C2=A0 device=C2=A0=C2=A0=C2=A0=C2=A0 =3D 'AR928X Wireless Net= work Adapter (PCI-Express)' =C2=A0=C2=A0=C2=A0 class=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 =3D network igb0@pci0:2:0:0:=C2=A0=C2=A0=C2=A0 class=3D0x020000 card=3D0x00008086 chip= =3D0x157b8086 rev=3D0x03 hdr=3D0x00 =C2=A0=C2=A0=C2=A0 vendor=C2=A0=C2=A0=C2=A0=C2=A0 =3D 'Intel Corporation' =C2=A0=C2=A0=C2=A0 device=C2=A0=C2=A0=C2=A0=C2=A0 =3D 'I210 Gigabit Networ= k Connection' =C2=A0=C2=A0=C2=A0 class=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 =3D network =C2=A0=C2=A0=C2=A0 subclass=C2=A0=C2=A0 =3D ethernet ppt1@pci0:3:0:0:=C2=A0=C2=A0=C2=A0 class=3D0x020000 card=3D0x00008086 chip= =3D0x157b8086 rev=3D0x03 hdr=3D0x00 =C2=A0=C2=A0=C2=A0 vendor=C2=A0=C2=A0=C2=A0=C2=A0 =3D 'Intel Corporation' =C2=A0=C2=A0=C2=A0 device=C2=A0=C2=A0=C2=A0=C2=A0 =3D 'I210 Gigabit Networ= k Connection' =C2=A0=C2=A0=C2=A0 class=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 =3D network =C2=A0=C2=A0=C2=A0 subclass=C2=A0=C2=A0 =3D ethernet ppt2@pci0:4:0:0:=C2=A0=C2=A0=C2=A0 class=3D0x020000 card=3D0x00008086 chip= =3D0x157b8086 rev=3D0x03 hdr=3D0x00 =C2=A0=C2=A0=C2=A0 vendor=C2=A0=C2=A0=C2=A0=C2=A0 =3D 'Intel Corporation' =C2=A0=C2=A0=C2=A0 device=C2=A0=C2=A0=C2=A0=C2=A0 =3D 'I210 Gigabit Networ= k Connection' =C2=A0=C2=A0=C2=A0 class=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 =3D network =C2=A0=C2=A0=C2=A0 subclass=C2=A0=C2=A0 =3D ethernet in my vm-bhyve config I have passthru0=3D"1/0/0" passthru1=3D"4/0/0" which works nicely with the i210 adapter, but not with the wifi adapter. The wifi adapter also works when not passing through and using it via the host. In the VM (tried both the 12.2-RELEASE and 13.0-RC3), I have tried to load/unload various modules (or e.g. tried dev.ath.0.hal.force_full_reset=3D1), I do not get any connections, wifi scans/lists do not work. Other configurations result in "ath0: Device timeout" or in "wlan0: CTRL-EVENT-SCAN-FAILED ret=3D-1 retry=3D1". Any ideas how to resolve that? Regards, Robert From owner-freebsd-virtualization@freebsd.org Sun Mar 28 21:00:13 2021 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 389AB5AE954 for ; Sun, 28 Mar 2021 21:00:13 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4F7p4r5TFrz3Nnf for ; Sun, 28 Mar 2021 21:00:12 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: by mailman.nyi.freebsd.org (Postfix) id BB48C5AEA46; Sun, 28 Mar 2021 21:00:12 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id B74A95AE5F9 for ; Sun, 28 Mar 2021 21:00:12 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F7p4r3Pbvz3NgQ for ; Sun, 28 Mar 2021 21:00:12 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 5761226CA5 for ; Sun, 28 Mar 2021 21:00:12 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12SL0CeZ092383 for ; Sun, 28 Mar 2021 21:00:12 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12SL0Ctw092382 for virtualization@FreeBSD.org; Sun, 28 Mar 2021 21:00:12 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202103282100.12SL0Ctw092382@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: virtualization@FreeBSD.org Subject: Problem reports for virtualization@FreeBSD.org that need special attention Date: Sun, 28 Mar 2021 21:00:12 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 28 Mar 2021 21:00:13 -0000 To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- In Progress | 247208 | mpt(4): VMWare virtualized LSI controller panics New | 240945 | [hyper-v] [netvsc] hn network driver incorrectly 2 problems total for which you should take action. From owner-freebsd-virtualization@freebsd.org Wed Mar 31 18:59:25 2021 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 221D15AC908 for ; Wed, 31 Mar 2021 18:59:25 +0000 (UTC) (envelope-from olevole@olevole.ru) Received: from mail-ej1-x633.google.com (mail-ej1-x633.google.com [IPv6:2a00:1450:4864:20::633]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F9bG32CN2z4VHr for ; Wed, 31 Mar 2021 18:59:22 +0000 (UTC) (envelope-from olevole@olevole.ru) Received: by mail-ej1-x633.google.com with SMTP id u21so31598014ejo.13 for ; Wed, 31 Mar 2021 11:59:22 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=olevole-ru.20150623.gappssmtp.com; s=20150623; h=mime-version:from:date:message-id:subject:to; bh=eFcDGBIWcCogPhOj8A6UlEabYkUceBXy/qAmIvrotcU=; b=tPIEsePKd+iF/QKYUyx/5s3rCVb9EJCmEecv5IcnnmB4aolytx81+7x7G5j57/VcTm nhbvPinP5msWuX/4kT+nLORymvEhS4Y3pFLVS64JWUoiM09SPEfdiNmWbYkY9FhduBuj LfXfaUviHDXD7lejYYx3FAyPO+rXW59Gxy4HKBKLCGSuOtdzbBaQ+iojSk1hnJPzu74B sKZjIHLZ74hAYhuYEXQX8acWdazgNBaFCV9asf0GLI7AE+Rq2/PQuSYQ+lWYkiegM4Sw 2Xd7zc8/RHc/CkmYnuz4rsaTj1vuo1WBXQ/PAxsWDqeFez8tTGIsRW2RlFBhc2lanHzt dCow== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=eFcDGBIWcCogPhOj8A6UlEabYkUceBXy/qAmIvrotcU=; b=ewKCrQoqTAmiBcurzydN5/AXC2sCLefsKdGXvfxyHall6h9jg9GFLkxxUNQ19zWDgs R7DzY6WrARO0murauzf7DfhjmKiMpjCffOIrRwbZ3Ac7jDV/4UY5FM/KS8YbnBIN3Rda 15LgqkBnxuR473bT2l46dnPy0hyBVIhJD01V9na6WrwcObGfb60iGWWxiNc4ucEL/El4 Uo1RiPwjEk7qhaPgOOWUcER2T04OTvM2E3YhuovMCEy9gdS/g8wPvP4V3Z6nXgO2eKIJ O07wzWUAQc3CWHr7HeIs1F+vpf9worb0wm8wtk62XppFzoctH3TIZC6ytTFRop3FrgFd L7LQ== X-Gm-Message-State: AOAM531nXe2cCP+LXkz21tCl22nU/z938twgkG3MMHbV8knUqTFzZVa1 2sXXgEnMa0ZWRLXk7y0RNvo0hT/LGg+2v+8hRdNVUx8M2DO8ZM4Q X-Google-Smtp-Source: ABdhPJzir+Bq/jga9FpuV/sz6NCE3LnXUTMNhcLoaLY1dWny7C0iqWCAg+Pfd3nT4+rGeuahIn0EDdDYK0OVLVseKpA= X-Received: by 2002:a17:907:7014:: with SMTP id wr20mr5149016ejb.179.1617217160303; Wed, 31 Mar 2021 11:59:20 -0700 (PDT) MIME-Version: 1.0 From: Oleg Ginzburg Date: Wed, 31 Mar 2021 21:59:09 +0300 Message-ID: Subject: recent changed in vmm lead to panic: AMD, ivhd_setup_intr To: freebsd-virtualization@freebsd.org, khng@freebsd.org X-Rspamd-Queue-Id: 4F9bG32CN2z4VHr X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=olevole-ru.20150623.gappssmtp.com header.s=20150623 header.b=tPIEsePK; dmarc=none; spf=none (mx1.freebsd.org: domain of olevole@olevole.ru has no SPF policy when checking 2a00:1450:4864:20::633) smtp.mailfrom=olevole@olevole.ru X-Spamd-Result: default: False [-3.30 / 15.00]; RCVD_TLS_ALL(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[olevole-ru.20150623.gappssmtp.com:s=20150623]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[olevole.ru]; SPAMHAUS_ZRD(0.00)[2a00:1450:4864:20::633:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[olevole-ru.20150623.gappssmtp.com:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::633:from]; NEURAL_HAM_SHORT(-1.00)[-1.000]; R_SPF_NA(0.00)[no SPF record]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RBL_DBL_DONT_QUERY_IPS(0.00)[2a00:1450:4864:20::633:from]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-virtualization] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 31 Mar 2021 18:59:25 -0000 Hi, Over the past two weeks some changes appeared, which lead to a panic while trying to load the VMM kernel module. Kernel and revision with which everything was fine: FreeBSD 14.0-CURRENT #0 main-n245511-a771bf748f9: Thu Mar 18 06:35:21 UTC 2021 Latest builds get panic: https://paste.pics/C2FOS CPU: AMD Ryzen 7 PRO 3700U w/ Radeon Vega Mobile Gfx (2295.74-MHz K8-class CPU) ( Thinkpad t495s ) I see possible commits that could affect this behavior (all previous months before that moment, the VMM module works fine on the current equipment): https://cgit.freebsd.org/src/commit/?id=ede14736fd6d74db0374f4a233491ad5dc0e9b1d https://cgit.freebsd.org/src/commit/?id=74ada297e8978b8efda3dffdd1bb24aee7c5faa4 If you need to provide additional information that will help diagnose the problem - please inform. From owner-freebsd-virtualization@freebsd.org Wed Mar 31 19:00:47 2021 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 148595ACAD6 for ; Wed, 31 Mar 2021 19:00:47 +0000 (UTC) (envelope-from khng@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F9bHg0Bfgz4Vc1; Wed, 31 Mar 2021 19:00:47 +0000 (UTC) (envelope-from khng@FreeBSD.org) Received: from Kas-MacBook-Pro.lan (unknown [IPv6:2001:470:f816:0:f523:df21:9e7f:8cba]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) (Authenticated sender: khng/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 55F28A6DC; Wed, 31 Mar 2021 19:00:46 +0000 (UTC) (envelope-from khng@FreeBSD.org) Subject: Re: recent changed in vmm lead to panic: AMD, ivhd_setup_intr To: Oleg Ginzburg , freebsd-virtualization@freebsd.org References: From: Ka Ho Ng Message-ID: <7559a304-3188-4df9-24cd-09f0bdb8c120@FreeBSD.org> Date: Thu, 1 Apr 2021 03:00:43 +0800 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:78.0) Gecko/20100101 Thunderbird/78.9.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-GB Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 31 Mar 2021 19:00:47 -0000 On 4/1/21 2:59 am, Oleg Ginzburg wrote: > Hi, > > Over the past two weeks some changes appeared, which lead to a panic > while trying to load the VMM kernel module. > > Kernel and revision with which everything was fine: > FreeBSD 14.0-CURRENT #0 main-n245511-a771bf748f9: Thu Mar 18 06:35:21 > UTC 2021 > > Latest builds get panic: https://paste.pics/C2FOS > > CPU: AMD Ryzen 7 PRO 3700U w/ Radeon Vega Mobile Gfx (2295.74-MHz > K8-class CPU) > ( Thinkpad t495s ) > > I see possible commits that could affect this behavior (all previous > months before that moment, the VMM module works fine on the current > equipment): > > https://cgit.freebsd.org/src/commit/?id=ede14736fd6d74db0374f4a233491ad5dc0e9b1d > > https://cgit.freebsd.org/src/commit/?id=74ada297e8978b8efda3dffdd1bb24aee7c5faa4 > > > If you need to provide additional information that will help diagnose > the problem - please inform. I will look into it, thanks. Ka Ho From owner-freebsd-virtualization@freebsd.org Wed Mar 31 20:02:12 2021 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8ED125AE234 for ; Wed, 31 Mar 2021 20:02:12 +0000 (UTC) (envelope-from khng@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F9cfX3gygz4YrG; Wed, 31 Mar 2021 20:02:12 +0000 (UTC) (envelope-from khng@FreeBSD.org) Received: from Kas-MacBook-Pro.lan (unknown [IPv6:2001:470:f816:0:f523:df21:9e7f:8cba]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) (Authenticated sender: khng/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id C3CA5B5D6; Wed, 31 Mar 2021 20:02:11 +0000 (UTC) (envelope-from khng@FreeBSD.org) To: Oleg Ginzburg , freebsd-virtualization@freebsd.org References: From: Ka Ho Ng Subject: Re: recent changed in vmm lead to panic: AMD, ivhd_setup_intr Message-ID: <51113310-d4f3-a38a-b3cb-bd8d55a280cc@FreeBSD.org> Date: Thu, 1 Apr 2021 04:02:09 +0800 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:78.0) Gecko/20100101 Thunderbird/78.9.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-GB Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 31 Mar 2021 20:02:12 -0000 On 4/1/21 2:59 am, Oleg Ginzburg wrote: > Hi, > > Over the past two weeks some changes appeared, which lead to a panic > while trying to load the VMM kernel module. > > Kernel and revision with which everything was fine: > FreeBSD 14.0-CURRENT #0 main-n245511-a771bf748f9: Thu Mar 18 06:35:21 > UTC 2021 > > Latest builds get panic: https://paste.pics/C2FOS > > CPU: AMD Ryzen 7 PRO 3700U w/ Radeon Vega Mobile Gfx (2295.74-MHz > K8-class CPU) > ( Thinkpad t495s ) > Could I have your output of pciconf -lc pci0:0:0:2 and other IOMMU subclass devices, and also the ACPI ivrs table? You could generate the ivrs table dump by /usr/local/bin/acpidump -b, and the table will be available as ivrs.dat in the current directory. Ka Ho From owner-freebsd-virtualization@freebsd.org Wed Mar 31 20:37:11 2021 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id BF2D35AFE25 for ; Wed, 31 Mar 2021 20:37:11 +0000 (UTC) (envelope-from olevole@olevole.ru) Received: from mail-ed1-x535.google.com (mail-ed1-x535.google.com [IPv6:2a00:1450:4864:20::535]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F9dQv4wBfz4cNY for ; Wed, 31 Mar 2021 20:37:11 +0000 (UTC) (envelope-from olevole@olevole.ru) Received: by mail-ed1-x535.google.com with SMTP id z1so23834057edb.8 for ; Wed, 31 Mar 2021 13:37:11 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=olevole-ru.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=a64DthBDxVZDLzoJbLz+z3f9GwF/2+YJUC8VIWA6mlM=; b=xYyD5/PKl6vCMsy+Qqb6uSEhAUEJmqKK6j11DrP1TSC2uR6PauuL3LbcpLiVygGR8h /aRgCkvOQT2KmM/1yLIKPFMT0rIiLHZrCVonFKEJYt03+73ltWUU3aQ0jjpfUpwrgw/3 xahSg6cuyivqjzhqnY9LexRhTpu9holOFYERTY6bCYy9FtXFeohWMkyg2jVnsXUxkzLA eRBaqgwALk4DtgUluMu9CwvXqZ/ieFQu+TpZQ4nnp5nGCl6fA1d8hNFmlT0fgI+jbH9r 4keQNYDCOPI6XvXTBPS+jTvErRdwfIgdcJIGllopRCO5mHu4DQpvvA3Y9wPPw81STd/n dwVg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=a64DthBDxVZDLzoJbLz+z3f9GwF/2+YJUC8VIWA6mlM=; b=NKKQIeDTfKnABIkpWLuBOXj6fPyXvAsdDbBdLXePDAKn8z/9W+5sVXvwuAIU75uhKF l4fvSaA7tj7+Jc+uQSXVK8ofjbXMl4er5WWMX2dFIHC3oXzSlwJTNv4HL+r7fej7grgG RnE78EGTnZsenCHSp725cpYqoQUdhSjb313b+I1Qd7OvtF+XipIKUodFWf2wa9H5vL9n HKYoZKMNevTi+5AOQ7aVWoKjO5RdVXiH9owNPO4kLLhnSMyj8XB0nVwqtZ4A0qKB/T+j jrK6/b/dO23xSM85hMxAvAIohe8PEivx6/VZ1MQ1ZOrYOmKddxaeXxMSgKxsabwhk05R d8Kg== X-Gm-Message-State: AOAM532gd7Cb8J/j0JD2OObOrnasg9GwsXyfJsigSpwvIx6D/8HxWOXc XsIFBG41Vzj3oJ/rd2dGf+oA49Rh8OE1y0vsyfuGiw== X-Google-Smtp-Source: ABdhPJzQ1llXzTL9JSinhrRuxkubNq4oArJobs3Xs7ktp/2oE6dguRtjJYFRoiF4jRkh1TRZ6OnxgEduPpeXGnkMbno= X-Received: by 2002:a05:6402:1855:: with SMTP id v21mr6055737edy.310.1617223030087; Wed, 31 Mar 2021 13:37:10 -0700 (PDT) MIME-Version: 1.0 References: <51113310-d4f3-a38a-b3cb-bd8d55a280cc@FreeBSD.org> In-Reply-To: <51113310-d4f3-a38a-b3cb-bd8d55a280cc@FreeBSD.org> From: Oleg Ginzburg Date: Wed, 31 Mar 2021 23:36:58 +0300 Message-ID: Subject: Re: recent changed in vmm lead to panic: AMD, ivhd_setup_intr To: Ka Ho Ng Cc: freebsd-virtualization@freebsd.org X-Rspamd-Queue-Id: 4F9dQv4wBfz4cNY X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 31 Mar 2021 20:37:11 -0000 Thanks for the quick response! On Wed, Mar 31, 2021 at 11:02 PM Ka Ho Ng wrote: > Could I have your output of pciconf -lc pci0:0:0:2 and other IOMMU > subclass devices, and also the ACPI ivrs table? You could generate the > ivrs table dump by /usr/local/bin/acpidump -b, and the table will be > available as ivrs.dat in the current directory. > > 1) pciconv -vl: https://pastebin.com/A95F9XLe 2) pciconf -lc pci0:0:0:2 none0@pci0:0:0:2: class=0x080600 rev=0x00 hdr=0x00 vendor=0x1022 device=0x15d1 subvendor=0x1022 subdevice=0x15d1 cap 0f[40] = unknown cap 05[64] = MSI supports 4 messages, 64 bit cap 08[74] = HT MSI fixed address window enabled at 0xfee00000 3) FreeBSD acpidump does not have the '-b' key, all that I found on ivls is: # acpidump -dt | grep -B1 -A3 IVRS /* IVRS: Length=318, Revision=2, Checksum=0, OEMID=LENOVO, OEM Table ID=TP-R13, OEM Revision=0x10e0, Creator ID=PTEC, Creator Revision=0x2 */ 4) egrep -i 'ivrs|ivh|amd-vi|mmu' /var/run/dmesg.boot pci0: at device 0.2 (no driver attached) > Ka Ho > From owner-freebsd-virtualization@freebsd.org Wed Mar 31 20:41:09 2021 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 36DCB5AFD61 for ; Wed, 31 Mar 2021 20:41:09 +0000 (UTC) (envelope-from khng@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F9dWT1Bhgz4cQx; Wed, 31 Mar 2021 20:41:09 +0000 (UTC) (envelope-from khng@FreeBSD.org) Received: from Kas-MacBook-Pro.lan (unknown [IPv6:2001:470:f816:0:f523:df21:9e7f:8cba]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) (Authenticated sender: khng/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 6EE79C02C; Wed, 31 Mar 2021 20:41:08 +0000 (UTC) (envelope-from khng@FreeBSD.org) Subject: Re: recent changed in vmm lead to panic: AMD, ivhd_setup_intr To: Oleg Ginzburg Cc: freebsd-virtualization@freebsd.org References: <51113310-d4f3-a38a-b3cb-bd8d55a280cc@FreeBSD.org> From: Ka Ho Ng Message-ID: Date: Thu, 1 Apr 2021 04:41:06 +0800 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:78.0) Gecko/20100101 Thunderbird/78.9.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-GB Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 31 Mar 2021 20:41:09 -0000 On 4/1/21 4:36 am, Oleg Ginzburg wrote: > pci0: at device 0.2 (no driver attached) That is the most related cause to the panic. Currently the code assumes evaluating a propagated ACPI ivrs table will come with attached amd iommu devices as well. Thanks, Ka Ho From owner-freebsd-virtualization@freebsd.org Wed Mar 31 20:43:07 2021 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D20575B0197 for ; Wed, 31 Mar 2021 20:43:07 +0000 (UTC) (envelope-from khng@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F9dYl5ffdz4cny; Wed, 31 Mar 2021 20:43:07 +0000 (UTC) (envelope-from khng@freebsd.org) Received: from Kas-MacBook-Pro.lan (unknown [IPv6:2001:470:f816:0:f523:df21:9e7f:8cba]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) (Authenticated sender: khng/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 15242B9FE; Wed, 31 Mar 2021 20:43:06 +0000 (UTC) (envelope-from khng@freebsd.org) Subject: Re: recent changed in vmm lead to panic: AMD, ivhd_setup_intr From: Ka Ho Ng To: Oleg Ginzburg Cc: freebsd-virtualization@freebsd.org References: <51113310-d4f3-a38a-b3cb-bd8d55a280cc@FreeBSD.org> Organization: The FreeBSD Project Message-ID: <688df763-38bd-8eb9-4a71-961b3e48d5f2@freebsd.org> Date: Thu, 1 Apr 2021 04:43:05 +0800 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:78.0) Gecko/20100101 Thunderbird/78.9.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-GB Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 31 Mar 2021 20:43:07 -0000 On 4/1/21 4:41 am, Ka Ho Ng wrote: > On 4/1/21 4:36 am, Oleg Ginzburg wrote: >> pci0: at device 0.2 (no driver attached) > > That is the most related cause to the panic. Currently the code assumes > evaluating a propagated ACPI ivrs table will come with attached amd > iommu devices as well. > > Thanks, > Ka Ho Forgot to mention, /usr/local/bin/acpidump comes from sysutils/acpica-tools. Ka Ho From owner-freebsd-virtualization@freebsd.org Wed Mar 31 21:28:07 2021 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 45F385B18A4 for ; Wed, 31 Mar 2021 21:28:07 +0000 (UTC) (envelope-from khng@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F9fYg1FHzz4gT5; Wed, 31 Mar 2021 21:28:07 +0000 (UTC) (envelope-from khng@FreeBSD.org) Received: from Kas-MacBook-Pro.lan (unknown [IPv6:2001:470:f816:0:f523:df21:9e7f:8cba]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) (Authenticated sender: khng/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 62C2EC35E; Wed, 31 Mar 2021 21:28:06 +0000 (UTC) (envelope-from khng@FreeBSD.org) Subject: Re: recent changed in vmm lead to panic: AMD, ivhd_setup_intr From: Ka Ho Ng To: Oleg Ginzburg Cc: freebsd-virtualization@freebsd.org References: <51113310-d4f3-a38a-b3cb-bd8d55a280cc@FreeBSD.org> <688df763-38bd-8eb9-4a71-961b3e48d5f2@freebsd.org> Message-ID: <9b8652d4-d5a1-589f-c4ec-21908356315c@FreeBSD.org> Date: Thu, 1 Apr 2021 05:27:58 +0800 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:78.0) Gecko/20100101 Thunderbird/78.9.0 MIME-Version: 1.0 In-Reply-To: <688df763-38bd-8eb9-4a71-961b3e48d5f2@freebsd.org> Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="1bUbbpCqI0Jnoz2QHdxlRZVUj2PbNj7rM" X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 31 Mar 2021 21:28:07 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --1bUbbpCqI0Jnoz2QHdxlRZVUj2PbNj7rM Content-Type: multipart/mixed; boundary="odaE4p2BQq2IED14hHB0X5jh7od8y670K"; protected-headers="v1" From: Ka Ho Ng To: Oleg Ginzburg Cc: freebsd-virtualization@freebsd.org Message-ID: <9b8652d4-d5a1-589f-c4ec-21908356315c@FreeBSD.org> Subject: Re: recent changed in vmm lead to panic: AMD, ivhd_setup_intr References: <51113310-d4f3-a38a-b3cb-bd8d55a280cc@FreeBSD.org> <688df763-38bd-8eb9-4a71-961b3e48d5f2@freebsd.org> In-Reply-To: <688df763-38bd-8eb9-4a71-961b3e48d5f2@freebsd.org> --odaE4p2BQq2IED14hHB0X5jh7od8y670K Content-Type: multipart/mixed; boundary="------------D1DB66699CFC7E33DDF3A29D" Content-Language: en-GB This is a multi-part message in MIME format. --------------D1DB66699CFC7E33DDF3A29D Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: quoted-printable On 4/1/21 4:43 am, Ka Ho Ng wrote: > On 4/1/21 4:41 am, Ka Ho Ng wrote: >> On 4/1/21 4:36 am, Oleg Ginzburg wrote: >>> pci0: at device 0.2 (no driver attached) >> >> That is the most related cause to the panic. Currently the code=20 >> assumes evaluating a propagated ACPI ivrs table will come with=20 >> attached amd iommu devices as well. >> >> Thanks, >> Ka Ho >=20 > Forgot to mention, /usr/local/bin/acpidump comes from > sysutils/acpica-tools. >=20 > Ka Ho > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to=20 > "freebsd-virtualization-unsubscribe@freebsd.org" Could you try the attached quick dirty fix and see if it works? Ka Ho --------------D1DB66699CFC7E33DDF3A29D Content-Type: text/plain; charset=UTF-8; x-mac-type="0"; x-mac-creator="0"; name="quick.patch" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="quick.patch" ZGlmZiAtLWdpdCBhL3N5cy9hbWQ2NC92bW0vYW1kL2l2cnNfZHJ2LmMgYi9zeXMvYW1kNjQv dm1tL2FtZC9pdnJzX2Rydi5jCmluZGV4IDYyOTE4OTVjMjEyZi4uZDJlM2QwYjBhY2RiIDEw MDY0NAotLS0gYS9zeXMvYW1kNjQvdm1tL2FtZC9pdnJzX2Rydi5jCisrKyBiL3N5cy9hbWQ2 NC92bW0vYW1kL2l2cnNfZHJ2LmMKQEAgLTEyMiw3ICsxMjIsNiBAQCBpdnJzX2lzX2l2aGQo VUlOVDggdHlwZSkKIAlzd2l0Y2godHlwZSkgewogCWNhc2UgSVZSU19UWVBFX0hBUkRXQVJF X0xFR0FDWToKIAljYXNlIElWUlNfVFlQRV9IQVJEV0FSRV9FRlI6Ci0JY2FzZSBJVlJTX1RZ UEVfSEFSRFdBUkVfTUlYRUQ6CiAJCXJldHVybiAodHJ1ZSk7CiAKIAlkZWZhdWx0Ogo= --------------D1DB66699CFC7E33DDF3A29D-- --odaE4p2BQq2IED14hHB0X5jh7od8y670K-- --1bUbbpCqI0Jnoz2QHdxlRZVUj2PbNj7rM Content-Type: application/pgp-signature; name="OpenPGP_signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="OpenPGP_signature" -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEE/ss/BuZP/7ECOIRk+Ytl9YmuY3EFAmBk6V4ACgkQ+Ytl9Ymu Y3GTSg/8C+AgYU5bVa4IFsZ+Lq9DdgL6HJr6PwQuIb6LOvp+M1chHphwprz1KcZ1 vDEPZfkgf8U6gfupzcwdsfcJoHH/e/HdT+5bpDmTOwS90p3qhe7+kfJCYESj5tef BPNtB4Q4gDyYkCH4x017yBZH+kTuqu+XVLlwiw1IVxQms19w+iI6MTQackiM23UG 3Kz8NbBeHZYrwKGAGa/YkTR4f6SMlqKHCKwWfHnutrFJQRVEk+vEs83vGM6QY50z ZH00YlzzHLyuv4I58RR2z1+yl+kbXXHhcUWF0o8wJRi7/ACvWgV21rSG9nWQrSaG OGp5Ompf01bvQ4cQWdWISPYL8be/YMty0heKbDf7QYedqpMRTSE29Bn7POoUKfqq F+gBi7fHvJO/8pWuVHqyCGAKQtMnRHx2CRhFFtDUeG95gok5CY+pByco7FFsuBXc n+u+JQg5/V6y0jvYtoa9TrKpO0ryGMwr/oiyOVX8FMHjVxm+rnh2sadtfui3gaCJ bhJtrOORjAUByQ+5PgPIzr6iLj62JfJom9qUpfJ1b9LU+fPbzifPF0IkIo24KqY9 ZU/ywLStKc/ORfmDte5NNM950iJqVg4//M7cvk9upPl8/EkOS33CoqH0fIztCmbl RLD70RJlwLBPPalmbYnJhQZlRLcRJsfK3ucHZdIPJp96czG6LIQ= =i76J -----END PGP SIGNATURE----- --1bUbbpCqI0Jnoz2QHdxlRZVUj2PbNj7rM-- From owner-freebsd-virtualization@freebsd.org Wed Mar 31 22:18:38 2021 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 03AA25B2DF3 for ; Wed, 31 Mar 2021 22:18:38 +0000 (UTC) (envelope-from khng@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F9ggx6mPjz4k3M; Wed, 31 Mar 2021 22:18:37 +0000 (UTC) (envelope-from khng@FreeBSD.org) Received: from Kas-MacBook-Pro.lan (unknown [IPv6:2001:470:f816:0:f523:df21:9e7f:8cba]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) (Authenticated sender: khng/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 46214C37E; Wed, 31 Mar 2021 22:18:37 +0000 (UTC) (envelope-from khng@FreeBSD.org) Subject: Re: recent changed in vmm lead to panic: AMD, ivhd_setup_intr From: Ka Ho Ng To: Oleg Ginzburg Cc: freebsd-virtualization@freebsd.org References: <51113310-d4f3-a38a-b3cb-bd8d55a280cc@FreeBSD.org> <688df763-38bd-8eb9-4a71-961b3e48d5f2@freebsd.org> <9b8652d4-d5a1-589f-c4ec-21908356315c@FreeBSD.org> Message-ID: Date: Thu, 1 Apr 2021 06:18:34 +0800 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:78.0) Gecko/20100101 Thunderbird/78.9.0 MIME-Version: 1.0 In-Reply-To: <9b8652d4-d5a1-589f-c4ec-21908356315c@FreeBSD.org> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-GB Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 31 Mar 2021 22:18:38 -0000 On 4/1/21 5:27 am, Ka Ho Ng wrote: > On 4/1/21 4:43 am, Ka Ho Ng wrote: >> On 4/1/21 4:41 am, Ka Ho Ng wrote: >>> On 4/1/21 4:36 am, Oleg Ginzburg wrote: >>>> pci0: at device 0.2 (no driver attached) >>> >>> That is the most related cause to the panic. Currently the code >>> assumes evaluating a propagated ACPI ivrs table will come with >>> attached amd iommu devices as well. >>> >>> Thanks, >>> Ka Ho >> >> Forgot to mention, /usr/local/bin/acpidump comes from >> sysutils/acpica-tools. >> >> Ka Ho >> _______________________________________________ >> freebsd-virtualization@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization >> To unsubscribe, send any mail to >> "freebsd-virtualization-unsubscribe@freebsd.org" > > Could you try the attached quick dirty fix and see if it works? > > Ka Ho For your reference, here is the differential: https://reviews.freebsd.org/D29521 Best, Ka Ho From owner-freebsd-virtualization@freebsd.org Thu Apr 1 07:22:10 2021 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 5AE355B8E28 for ; Thu, 1 Apr 2021 07:22:10 +0000 (UTC) (envelope-from olevole@olevole.ru) Received: from mail-ed1-x534.google.com (mail-ed1-x534.google.com [IPv6:2a00:1450:4864:20::534]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F9vl61Mryz4mWM for ; Thu, 1 Apr 2021 07:22:09 +0000 (UTC) (envelope-from olevole@olevole.ru) Received: by mail-ed1-x534.google.com with SMTP id b16so787298eds.7 for ; Thu, 01 Apr 2021 00:22:09 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=olevole-ru.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=usmdoFptmiSxXrsEf2WmQbdyeQw/nXOAj2ed6EcKJcQ=; b=uXHnBxSOaUikbJkDCz/JRFdSAS7Qdth1gGCi/6nIkZAecaADSpYA4fIiPZ8VXmViRo 6ONvLqacNFL+/CHy4oEc07Wn9zfjSLPGTmdvlF3pkn8n/08bE2M5RNIRodrb1OkIae8A B6G6TH7KqdftZhrLbSjEuygg1oT2H2amrRaUExpWMwfGJ23DF4rgJeu4W7fmkU8eLmNd KYQU99oGfbS1+mzOsRzNm9bbsJhitotxTKVXO7WAv1nv7Ys1Hn/RDqG1alBp/Rkk6o3U EqqPBVwpRYDe3+zS7MlKkLBiEbsEgnwWQO0sqUR9kHnk/OzhBVaJXSsdPUk+LoREcvm4 4X4Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=usmdoFptmiSxXrsEf2WmQbdyeQw/nXOAj2ed6EcKJcQ=; b=tYjStjEV2Maxyj+l5UWL7zuXgaWAqoCM51yBnW3Qkqg1k/Rb81TRUJO3E2fNiul0pZ 6jTlP6rpneL7ZhO7KUZ0ZBon61wk7A5BqqE1ER3WUB3KIaYNchmuVgwjFPRgLPJXdqJn 8rtUookSnAbXoGuRDq0Tw5MmRTG0DmjfOh9dEe5hX6XBX85IaBCgwkXv9GYhlLnYLifZ 9qzYApxl1MTqXQrYpiTnhrrm5o4sEtsSLI0R13Jgvbls9qh3+IPhl7uduoLU5RGBx7yo L2iJUfAWmgbuNVMlmmL/SYu0IEX0lztwv4hNUvOTwHhTH1rIfEcNxA4Q++2LgB9C4yNS PLXQ== X-Gm-Message-State: AOAM531m83K0u3D/Vy2bn/baj/XN2io2dZ0eNf/TBuOTvlI2qJcle/sd 0cEOJiw4OnZfYScvuua4sd1sq6s4KIILXQYYDLKGgbKTP9FM2Yh1 X-Google-Smtp-Source: ABdhPJw78jxTWiym9Amg607+SJ+i3X3BO9w+hGXVUtDkofiuIYVoe6XksbeVsZ+er6AukbZYNMcVUl6Lq0ZQuUDn6o4= X-Received: by 2002:aa7:d917:: with SMTP id a23mr8306353edr.122.1617261728301; Thu, 01 Apr 2021 00:22:08 -0700 (PDT) MIME-Version: 1.0 References: <51113310-d4f3-a38a-b3cb-bd8d55a280cc@FreeBSD.org> <688df763-38bd-8eb9-4a71-961b3e48d5f2@freebsd.org> <9b8652d4-d5a1-589f-c4ec-21908356315c@FreeBSD.org> In-Reply-To: From: Oleg Ginzburg Date: Thu, 1 Apr 2021 10:21:56 +0300 Message-ID: Subject: Re: recent changed in vmm lead to panic: AMD, ivhd_setup_intr To: Ka Ho Ng Cc: freebsd-virtualization@freebsd.org X-Rspamd-Queue-Id: 4F9vl61Mryz4mWM X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 01 Apr 2021 07:22:10 -0000 Both patch ( quick patch and/or https://reviews.freebsd.org/D29521 ) solve panic: # kldload vmm amdiommu0 at device 0.2 on pci0 AMD-Vi: IVRS Info VAsize = 64 PAsize = 48 GVAsize = 2 flags:0 driver bug: Unable to set devclass (class: ppc devname: (unknown)) driver bug: Unable to set devclass (class: ppc devname: (unknown)) ivhd0: on acpi0 ivhd0: Flag:b0 ivhd0: Features(type:0x11) MsiNumPPR = 0 PNBanks= 2 PNCounters= 0 ivhd0: Extended features[31:0]:22294ada HATS = 0x2 GATS = 0x0 GLXSup = 0x1 SmiFSup = 0x1 SmiFRC = 0x2 GAMSup = 0x1 DualPortLogSup = 0x2 DualEventLogSup = 0x2 ivhd0: Extended features[62:32]:4f77ef Max PASID: 0x2f DevTblSegSup = 0x3 MarcSup = 0x1 ivhd0: supported paging level:7, will use only: 4 ivhd0: device range: 0x0 - 0xffff ivhd0: PCI cap 0x190b640f@0x40 feature:19 However, the bhyve process is crashed: .. fbuf frame buffer base: 0x844600000 [sz 16777216] pci_xhci no USB devices configured ld-elf.so.1: /usr/sbin/bhyve: Undefined symbol "vm_munmap_memseg" On Thu, Apr 1, 2021 at 1:18 AM Ka Ho Ng wrote: > On 4/1/21 5:27 am, Ka Ho Ng wrote: > > On 4/1/21 4:43 am, Ka Ho Ng wrote: > >> On 4/1/21 4:41 am, Ka Ho Ng wrote: > >>> On 4/1/21 4:36 am, Oleg Ginzburg wrote: > >>>> pci0: at device 0.2 (no driver attached) > >>> > >>> That is the most related cause to the panic. Currently the code > >>> assumes evaluating a propagated ACPI ivrs table will come with > >>> attached amd iommu devices as well. > >>> > >>> Thanks, > >>> Ka Ho > >> > >> Forgot to mention, /usr/local/bin/acpidump comes from > >> sysutils/acpica-tools. > >> > >> Ka Ho > >> _______________________________________________ > >> freebsd-virtualization@freebsd.org mailing list > >> https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > >> To unsubscribe, send any mail to > >> "freebsd-virtualization-unsubscribe@freebsd.org" > > > > Could you try the attached quick dirty fix and see if it works? > > > > Ka Ho > > For your reference, here is the differential: > https://reviews.freebsd.org/D29521 > > Best, > Ka Ho > From owner-freebsd-virtualization@freebsd.org Thu Apr 1 07:27:52 2021 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D71D15BF970 for ; Thu, 1 Apr 2021 07:27:51 +0000 (UTC) (envelope-from khng@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F9vsg4H8tz4pYk; Thu, 1 Apr 2021 07:27:51 +0000 (UTC) (envelope-from khng@FreeBSD.org) Received: from Kas-MacBook-Pro.lan (unknown [IPv6:2001:470:f816:0:f523:df21:9e7f:8cba]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) (Authenticated sender: khng/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id A6F2D20E5E; Thu, 1 Apr 2021 07:27:50 +0000 (UTC) (envelope-from khng@FreeBSD.org) Subject: Re: recent changed in vmm lead to panic: AMD, ivhd_setup_intr To: Oleg Ginzburg Cc: freebsd-virtualization@freebsd.org References: <51113310-d4f3-a38a-b3cb-bd8d55a280cc@FreeBSD.org> <688df763-38bd-8eb9-4a71-961b3e48d5f2@freebsd.org> <9b8652d4-d5a1-589f-c4ec-21908356315c@FreeBSD.org> From: Ka Ho Ng Message-ID: <73d31884-8c31-2880-b0e6-8decade073ee@FreeBSD.org> Date: Thu, 1 Apr 2021 15:27:46 +0800 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:78.0) Gecko/20100101 Thunderbird/78.9.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-GB Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 01 Apr 2021 07:27:52 -0000 On 4/1/21 3:21 pm, Oleg Ginzburg wrote: > However, the bhyve process is crashed: > > .. > fbuf frame buffer base: 0x844600000 [sz 16777216] > pci_xhci no USB devices configured > ld-elf.so.1: /usr/sbin/bhyve: Undefined symbol "vm_munmap_memseg" > Did you update the libvmmapi as well during system upgrade? There's recently an addition of a few ioctls supporting pci bar remapping of emulated and passthrough devices. Ka Ho From owner-freebsd-virtualization@freebsd.org Thu Apr 1 17:11:17 2021 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id A86D55B0456 for ; Thu, 1 Apr 2021 17:11:17 +0000 (UTC) (envelope-from olevole@olevole.ru) Received: from mail-ed1-x52e.google.com (mail-ed1-x52e.google.com [IPv6:2a00:1450:4864:20::52e]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FB8ps4BPRz4YFQ for ; Thu, 1 Apr 2021 17:11:17 +0000 (UTC) (envelope-from olevole@olevole.ru) Received: by mail-ed1-x52e.google.com with SMTP id j3so2740949edp.11 for ; Thu, 01 Apr 2021 10:11:17 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=olevole-ru.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=6FQTzBjWGIEyK306wMxg/GufcsY6DuV2h1tyPOpnNlk=; b=OqASmL0gDR7BofFwnIaeR3Tti1LiIFGrOi97AXcfop6OcgdH3AM8a5OhSeJ0Ntzzti PYFPoj4jw9Olya1Mi9yV22k30YPuBds5jJMNcwh302yk4OI4M42P9zP8f8jJkDr67EM/ qeffbAuaAx4NdfKQVw8TlJtW0C8YDeVEkcZQ3mFvLdMCDNEk5pflcHIdO2pmBggLinl7 uzAt61SdkocToh7M14lzSRL6dhCnYbFd33BpgI06QVJS/fNzf83DJtb1EPy6/pM+R1xd wTYNn4GRaaASgAamu4DqUjSPjhW3JM1QpY1AYfCLwMf6m2cEEutUEzlyOKbiwBXry+cD JZNg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=6FQTzBjWGIEyK306wMxg/GufcsY6DuV2h1tyPOpnNlk=; b=cKQ1v1o1zou6+nlp4AUgAOH8b5I2g5UF175fen/YlUA3q8w0uRKJJ3LnoKWN9wD15T Wi3rvEXruIJ+sVgp7bIgOc9QRhbsT+qCL+HQ/7sF3k7vQ7IPLX4SKvz6fRn2gS0Bkwtg 6hKVNudd06ACQ1FtiwjUMAGshTtgKF82QPis5MOcI25yt3yhS1o5MR6Q1ECcG3pi38cx OslbcMJ7j5iZCetP3y4vWagzUfYuRko89Uatgf6+utnUcKad3oF6EU35Izq4dZRpL9zN axNfIBq4zALarX3X2PVgnr+Pd0YaeyLoKn3pM3SAQ47Sj9FrB8nEtHKBSrJXsdDc7wMB Bgdg== X-Gm-Message-State: AOAM533yWSwuW6s+Fhxi+MGyQV76yj1tEN9Y1oBp99a0bAso/hsQqs/0 7pxCX30nADsxQNhhhXf5zo6M3T+81qn8DnGf1rZaZQ== X-Google-Smtp-Source: ABdhPJzbD6yl84IiOwINecPaCHDXq7Zn2vpzGExzVNxcy1VwFWJGMdz/u7PPl3dcaPTg3EiOLT0nwOfoa9N6F4zSrWM= X-Received: by 2002:aa7:c346:: with SMTP id j6mr11042081edr.386.1617297075915; Thu, 01 Apr 2021 10:11:15 -0700 (PDT) MIME-Version: 1.0 References: <51113310-d4f3-a38a-b3cb-bd8d55a280cc@FreeBSD.org> <688df763-38bd-8eb9-4a71-961b3e48d5f2@freebsd.org> <9b8652d4-d5a1-589f-c4ec-21908356315c@FreeBSD.org> <73d31884-8c31-2880-b0e6-8decade073ee@FreeBSD.org> In-Reply-To: <73d31884-8c31-2880-b0e6-8decade073ee@FreeBSD.org> From: Oleg Ginzburg Date: Thu, 1 Apr 2021 20:11:04 +0300 Message-ID: Subject: Re: recent changed in vmm lead to panic: AMD, ivhd_setup_intr To: Ka Ho Ng Cc: freebsd-virtualization@freebsd.org X-Rspamd-Queue-Id: 4FB8ps4BPRz4YFQ X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 01 Apr 2021 17:11:17 -0000 On Thu, Apr 1, 2021 at 10:27 AM Ka Ho Ng wrote: > On 4/1/21 3:21 pm, Oleg Ginzburg wrote: > > However, the bhyve process is crashed: > > > > .. > > fbuf frame buffer base: 0x844600000 [sz 16777216] > > pci_xhci no USB devices configured > > ld-elf.so.1: /usr/sbin/bhyve: Undefined symbol "vm_munmap_memseg" > > > > Did you update the libvmmapi as well during system upgrade? There's > recently an addition of a few ioctls supporting pci bar remapping of > emulated and passthrough devices. > > Yes, for some reason 'bhyve' on my host was linked to /lib/libvmmapi.so.5 instead of /usr/lib/libvmmapi.so.5 % ldd `which bhyve` /usr/sbin/bhyve: libvmmapi.so.5 => /lib/libvmmapi.so.5 (0x8010c7000) .. I do not know where it came from, maybe from the old patch on the phabricator. Removing /lib/libvmmapi.so* fix my problem. Thanks for your work! From owner-freebsd-virtualization@freebsd.org Fri Apr 2 15:56:18 2021 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 5294A57B381 for ; Fri, 2 Apr 2021 15:56:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4FBl5t1SYTz3Kl6 for ; Fri, 2 Apr 2021 15:56:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 2F9B257B285; Fri, 2 Apr 2021 15:56:18 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 2F53C57B284 for ; Fri, 2 Apr 2021 15:56:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FBl5t0czWz3KLR for ; Fri, 2 Apr 2021 15:56:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 05E8E22734 for ; Fri, 2 Apr 2021 15:56:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 132FuHjn042807 for ; Fri, 2 Apr 2021 15:56:17 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 132FuHmY042806 for virtualization@FreeBSD.org; Fri, 2 Apr 2021 15:56:17 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 216759] [kern] Memory speed with small blocks (1K) up to 35 times slower than host system (under QEMU emulation, but not only) Date: Fri, 02 Apr 2021 15:56:16 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: dch@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc version Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 02 Apr 2021 15:56:18 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D216759 Dave Cottlehuber changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |dch@freebsd.org Version|11.0-RELEASE |13.0-STABLE --- Comment #19 from Dave Cottlehuber --- still present on 13.0-RC4 and earlier. This is the default setting on many cloud providers (e.g. Digital Ocean) so it's a really really nasty widespre= ad default. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Fri Apr 2 22:07:37 2021 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id AE3645B488F for ; Fri, 2 Apr 2021 22:07:37 +0000 (UTC) (envelope-from doctor@doctor.nl2k.ab.ca) Received: from doctor.nl2k.ab.ca (doctor.nl2k.ab.ca [204.209.81.1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FBvLJ6dDwz4Tp9 for ; Fri, 2 Apr 2021 22:07:36 +0000 (UTC) (envelope-from doctor@doctor.nl2k.ab.ca) Received: from doctor by doctor.nl2k.ab.ca with local (Exim 4.94 (FreeBSD)) (envelope-from ) id 1lSRXn-0005hz-Ov for freebsd-virtualization@freebsd.org; Fri, 02 Apr 2021 15:41:31 -0600 Date: Fri, 2 Apr 2021 15:41:31 -0600 From: The Doctor To: freebsd-virtualization@freebsd.org Subject: FreeBSD13/12 oddity Message-ID: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline X-Rspamd-Queue-Id: 4FBvLJ6dDwz4Tp9 X-Spamd-Bar: ++++++ X-Spamd-Result: default: False [7.00 / 15.00]; ARC_NA(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[204.209.81.1:from]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(0.00)[+a:c]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; GREYLIST(0.00)[pass,body]; NEURAL_SPAM_MEDIUM(1.00)[1.000]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[204.209.81.1:from:127.0.2.255]; RCVD_TLS_LAST(0.00)[]; RBL_VIRUSFREE_BOTNET(2.00)[204.209.81.1:from]; DMARC_POLICY_ALLOW(0.00)[nl2k.ab.ca,quarantine]; NEURAL_SPAM_LONG(1.00)[1.000]; NEURAL_SPAM_SHORT(1.00)[0.999]; BAD_REP_POLICIES(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:6171, ipnet:204.209.81.0/24, country:CA]; INTRODUCTION(2.00)[]; MAILMAN_DEST(0.00)[freebsd-virtualization]; RCVD_COUNT_TWO(0.00)[2] X-Spam: Yes X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 02 Apr 2021 22:07:37 -0000 I was testing AlmaLinux on bhyve. works on FreeBSD 13 but is crashes on 12 upon install. Huh? -- Member - Liberal International This is doctor@@nl2k.ab.ca Ici doctor@@nl2k.ab.ca Yahweh, Queen & country!Never Satan President Republic!Beware AntiChrist rising! Look at Psalms 14 and 53 on Atheism https://www.empire.kred/ROOTNK?t=94a1f39b If they can dehumanize the most innocent, they can dehumanize anyone. -unknown From owner-freebsd-virtualization@freebsd.org Sat Apr 3 01:32:31 2021 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 5CED85BA2C3 for ; Sat, 3 Apr 2021 01:32:31 +0000 (UTC) (envelope-from SRS0=NxUU=JA=freebsd.org=grehan@iredmail.onthenet.com.au) Received: from vito-vars.onthenet.com.au (vito-vars.OntheNet.com.au [203.13.68.24]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FBztk1CRfz4hXF for ; Sat, 3 Apr 2021 01:32:29 +0000 (UTC) (envelope-from SRS0=NxUU=JA=freebsd.org=grehan@iredmail.onthenet.com.au) Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12]) by vito-vars.onthenet.com.au (Postfix) with ESMTPS id 6ABDE20B5CBF for ; Sat, 3 Apr 2021 11:32:18 +1000 (AEST) Received: from iredmail.onthenet.com.au (iredmail.onthenet.com.au [203.13.68.150]) by alto.onthenet.com.au (Postfix) with ESMTPS id 53C5020926C0 for ; Sat, 3 Apr 2021 11:32:18 +1000 (AEST) Received: from iredmail.onthenet.com.au (iredmail.onthenet.com.au [127.0.0.1]) by iredmail.onthenet.com.au (Postfix) with ESMTP id 4C619213DFBB for ; Sat, 3 Apr 2021 11:32:18 +1000 (AEST) Received: from iredmail.onthenet.com.au ([127.0.0.1]) by iredmail.onthenet.com.au (iredmail.onthenet.com.au [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id Omny1IoJH3-N for ; Sat, 3 Apr 2021 11:32:18 +1000 (AEST) Received: from MacBook-Air-4.local (unknown [120.29.48.160]) by iredmail.onthenet.com.au (Postfix) with ESMTPSA id C6A2820D84BD; Sat, 3 Apr 2021 11:32:16 +1000 (AEST) Subject: Re: FreeBSD13/12 oddity To: The Doctor References: Cc: freebsd-virtualization@freebsd.org From: Peter Grehan Message-ID: Date: Sat, 3 Apr 2021 11:32:15 +1000 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.14; rv:78.0) Gecko/20100101 Thunderbird/78.6.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-CMAE-Score: 0 X-CMAE-Analysis: v=2.3 cv=BZdDLol2 c=1 sm=1 tr=0 a=A6CF0fG5TOl4vs6YHvqXgw==:117 a=3Ck/IrRnVhCx8hPbmLB4Dw==:17 a=IkcTkHD0fZMA:10 a=3YhXtTcJ-WEA:10 a=-Fe7UTvXXG8c5q532_UA:9 a=QEXdDO2ut3YA:10 X-CMAE-Score: 0 X-CMAE-Analysis: v=2.3 cv=B/4iLNlM c=1 sm=1 tr=0 a=mJOSnoNX3k71adV6TmU0eQ==:117 a=3Ck/IrRnVhCx8hPbmLB4Dw==:17 a=IkcTkHD0fZMA:10 a=3YhXtTcJ-WEA:10 a=-Fe7UTvXXG8c5q532_UA:9 a=QEXdDO2ut3YA:10 X-Rspamd-Queue-Id: 4FBztk1CRfz4hXF X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of SRS0=NxUU=JA=freebsd.org=grehan@iredmail.onthenet.com.au has no SPF policy when checking 203.13.68.24) smtp.mailfrom=SRS0=NxUU=JA=freebsd.org=grehan@iredmail.onthenet.com.au X-Spamd-Result: default: False [-1.80 / 15.00]; RCVD_TLS_LAST(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_COUNT_FIVE(0.00)[6]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; RBL_DBL_DONT_QUERY_IPS(0.00)[203.13.68.24:from]; AUTH_NA(1.00)[]; DMARC_NA(0.00)[freebsd.org]; SPAMHAUS_ZRD(0.00)[203.13.68.24:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_SPF_NA(0.00)[no SPF record]; FORGED_SENDER(0.30)[grehan@freebsd.org,SRS0=NxUU=JA=freebsd.org=grehan@iredmail.onthenet.com.au]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:9313, ipnet:203.13.68.0/23, country:AU]; FROM_NEQ_ENVFROM(0.00)[grehan@freebsd.org,SRS0=NxUU=JA=freebsd.org=grehan@iredmail.onthenet.com.au]; MAILMAN_DEST(0.00)[freebsd-virtualization] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 03 Apr 2021 01:32:31 -0000 > I was testing AlmaLinux on bhyve. > > works on FreeBSD 13> > but is crashes on 12 upon install. I tried on CURRENT and it also works (with UEFI). Were you using UEFI on 12 ? Same options as on 13 ? later, Peter. From owner-freebsd-virtualization@freebsd.org Sat Apr 3 02:37:52 2021 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E049C5BC692 for ; Sat, 3 Apr 2021 02:37:52 +0000 (UTC) (envelope-from doctor@doctor.nl2k.ab.ca) Received: from doctor.nl2k.ab.ca (doctor.nl2k.ab.ca [204.209.81.1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FC1L751X5z4mBh; Sat, 3 Apr 2021 02:37:51 +0000 (UTC) (envelope-from doctor@doctor.nl2k.ab.ca) Received: from doctor by doctor.nl2k.ab.ca with local (Exim 4.94 (FreeBSD)) (envelope-from ) id 1lSVrq-000DyN-Tm; Fri, 02 Apr 2021 20:18:30 -0600 Date: Fri, 2 Apr 2021 20:18:30 -0600 From: The Doctor To: Peter Grehan Cc: freebsd-virtualization@freebsd.org Subject: Re: FreeBSD13/12 oddity Message-ID: References: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Rspamd-Queue-Id: 4FC1L751X5z4mBh X-Spamd-Bar: ++++++ X-Spamd-Result: default: False [6.99 / 15.00]; RCVD_TLS_LAST(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[204.209.81.1:from]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(0.00)[+a]; MIME_GOOD(-0.10)[text/plain]; NEURAL_SPAM_SHORT(0.99)[0.988]; ARC_NA(0.00)[]; NEURAL_SPAM_MEDIUM(1.00)[1.000]; BAD_REP_POLICIES(0.10)[]; SPAMHAUS_ZRD(0.00)[204.209.81.1:from:127.0.2.255]; RBL_VIRUSFREE_BOTNET(2.00)[204.209.81.1:from]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(0.00)[nl2k.ab.ca,quarantine]; GREYLIST(0.00)[pass,body]; NEURAL_SPAM_LONG(1.00)[1.000]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:6171, ipnet:204.209.81.0/24, country:CA]; INTRODUCTION(2.00)[]; MAILMAN_DEST(0.00)[freebsd-virtualization]; RCVD_COUNT_TWO(0.00)[2] X-Spam: Yes X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 03 Apr 2021 02:37:52 -0000 On Sat, Apr 03, 2021 at 11:32:15AM +1000, Peter Grehan wrote: > > I was testing AlmaLinux on bhyve. > > works on FreeBSD 13> > but is crashes on 12 upon install. > I tried on CURRENT and it also works (with UEFI). > > Were you using UEFI on 12 ? Same options as on 13 ? > AFAIK yes, b ut I could be incorrect. > later, > > Peter. -- Member - Liberal International This is doctor@@nl2k.ab.ca Ici doctor@@nl2k.ab.ca Yahweh, Queen & country!Never Satan President Republic!Beware AntiChrist rising! Look at Psalms 14 and 53 on Atheism https://www.empire.kred/ROOTNK?t=94a1f39b If they can dehumanize the most innocent, they can dehumanize anyone. -unknown