From owner-freebsd-virtualization@freebsd.org Sun Mar 28 19:56:38 2021 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8A2DE5AC62C for ; Sun, 28 Mar 2021 19:56:38 +0000 (UTC) (envelope-from infoomatic@gmx.at) Received: from mout.gmx.net (mout.gmx.net [212.227.17.20]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mout.gmx.net", Issuer "TeleSec ServerPass Class 2 CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F7mgT53TDz3JFd for ; Sun, 28 Mar 2021 19:56:37 +0000 (UTC) (envelope-from infoomatic@gmx.at) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=gmx.net; s=badeba3b8450; t=1616961396; bh=HKVCfj/nR2P6OwiQHcQTgcUqRr44Hi38v48HpTBbnOE=; h=X-UI-Sender-Class:To:From:Subject:Date; b=DWHEHvzoiZKaSaMkZhUHOaWUD0iG0JLKCkQtEn1Mmb0in+WOHMdMn1Uol1v4hFCBm MyYNUEYYDpOWg3ka3ByZ1VXpSMBi5VaXahl47WplAw8Iut8LI/OnGzlfDzzboHB8Uu tmRjLbvTf3N2GowlcEespGWa1zdRsDYYlb8onwgM= X-UI-Sender-Class: 01bb95c1-4bf8-414a-932a-4f6e2808ef9c Received: from [10.0.1.209] ([178.114.229.50]) by mail.gmx.net (mrgmx105 [212.227.17.168]) with ESMTPSA (Nemesis) id 1MCsUC-1lHq553kIa-008vl4 for ; Sun, 28 Mar 2021 21:56:35 +0200 To: freebsd-virtualization@freebsd.org From: infoomatic Subject: bhyve iommu passthru ath0 Message-ID: <275fb099-a036-05fc-bd1f-706e1d01ff98@gmx.at> Date: Sun, 28 Mar 2021 21:56:35 +0200 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:78.0) Gecko/20100101 Thunderbird/78.9.0 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Content-Language: en-US X-Provags-ID: V03:K1:+ba3oJQ+lxRWW1nq0kgUZKugoBiN8ULc3+ATw7+lc1XCsCTusCp ibHaZMe3tKp39AlbACgN5lqbPvINTvx3b9mpkZaO5m8gYSebh827kAYIA9BdK1yCKwKRdRA IY2ZQ+dCs51vba0pnPqM33JK10Ohj3peKaxCpBvh7YIz0oQygiyZ2QlygRvogeaivHHVp+T tu4TMl1aIq686V2gvlFVg== X-Spam-Flag: NO X-UI-Out-Filterresults: notjunk:1;V03:K0:365084De59s=:atHzWBPI8nC3GGOnGyoJep 2HTW2oaIvSLVdacMySQwXKslYYsHI5mjAbBLKB42xVinldLsUCFRWZmIWMyJezTeknR8/o37g WBXWwJ5o6HwhJD3dxGHNFLLD2LGp41AqEFFFrKLS7hp7h75wITiVH7tqwYFCNl159+718MF1H hw02neRpZrNmAjRNcwcFBq/r390rIwNBWmdxjx5VeLhcZ2/2ekhSZ3gaq2o8mbOcb0u4LJsRJ lrNeXLczPkGcLOCnsdSota0szX6lrTAY2SUSKdfpU+pw7DOmdoEk3p4qwrkXzKfdvwl9Pfb6v zd0YICa9cWROSU+wiemi6AfjQZhTxB+7EwXCeUldiUzY7HINy44OO07U8DA4tK8EQ6dMbyq0/ c/wYOLTBGiZygBEvR+bCV8h5ikyWpSit245c0UHHNIbA0ocUna97LXxPD7gizm/zOJSk+xzp/ UIYQq+tJYs/v8m8QZdfHkObYOjnru3oOFPTg6aUfAHr0/t9F+J8xGPwthlD2CY/HIaTBdS2kY K/KOIEouDxGIfzPIfhW29tUVdW8C47w4EKer+6YZEQ+UEaBwkzMG8EWnrfMO+hUq2mq/tdlGA kYT6XVuqqrm8EcOLzBUTUWxMf61OkTlWkQRn44rpKM6lysYUoNIwxxdy1XcNLR9ok4iCrNiu9 o60xkZWhlob4NLgQLa8k3uQSM9WP3tDtM4YHD6sMD+38Rh7pAZHYPNmKc2tyNGpHDL7UtBSDA uBMBVYy4+EvzdOpNFfIJHY013f/uPK5Tu9t6bWJUaLK6kDp775qEuzxeOdfFjdJ88/TpsA7hX 3pCBkvDZfiwMGAAEdlGwhvaW/E2UUe44XMfbLbqPk9/qpK12CaiOhOMGFnDdG3EZ54XEQ977w iQlcgubbi0IgA+zCd1xZ1upqLpC5U2QxjvkVh8XaDehPmZAQ29ly5r9z/w2JF9FZeUnfO4lvu CXnoOcrG3wClCbiYojP8jRp2vB6AjkGSfiLtevmz9OKiYLv7ot/ApkC3Er/84YOPBZF5TksoH jPDvbo2EOsyLDW8XqsTkzq2Z26oG5N2nNPsAnLpTatbP9PARLB4pcxqETJ/CopdwBZrlcuBS5 6rLorNHtdAfQ6BBX6w6MoZpax1bCt2D/GFDXbGw3x0XfKGHqV5pVFGbH5dlEfOHeRP8ipfvMH si01pfG4m8BOl/9ExVl4wJ0EMAMQHfJRb1mlH2+q0IcxcbrcG63c4DnNobbNA1JbwhCO4= X-Rspamd-Queue-Id: 4F7mgT53TDz3JFd X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmx.net header.s=badeba3b8450 header.b=DWHEHvzo; dmarc=pass (policy=none) header.from=gmx.at; spf=pass (mx1.freebsd.org: domain of infoomatic@gmx.at designates 212.227.17.20 as permitted sender) smtp.mailfrom=infoomatic@gmx.at X-Spamd-Result: default: False [-4.10 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; FREEMAIL_FROM(0.00)[gmx.at]; R_SPF_ALLOW(-0.20)[+ip4:212.227.17.0/27]; TO_DN_NONE(0.00)[]; DKIM_TRACE(0.00)[gmx.net:+]; DMARC_POLICY_ALLOW(-0.50)[gmx.at,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RCVD_IN_DNSWL_LOW(-0.10)[212.227.17.20:from]; FROM_EQ_ENVFROM(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[212.227.17.20:from]; FREEMAIL_ENVFROM(0.00)[gmx.at]; MID_RHS_MATCH_FROM(0.00)[]; ASN(0.00)[asn:8560, ipnet:212.227.0.0/16, country:DE]; MIME_TRACE(0.00)[0:+]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[gmx.net:s=badeba3b8450]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[212.227.17.20:from:127.0.2.255]; RWL_MAILSPIKE_POSSIBLE(0.00)[212.227.17.20:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-virtualization] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 28 Mar 2021 19:56:38 -0000 Hi all, I own a pcengines apu2e4 where bhyve passthru is working in general. Passing through the i210AT NICs works fine. However, I bought a Compex WLE200NX a/b/g/n miniPCI card which is based on the Qualcomm Atheros AR9280 chip I also want to pass through. On the host I am running 12.2-RELEASE-p5. my loader.conf: hw.vmm.amdvi.enable=3D1 vmm_load=3D"YES" pptdevs=3D"1/0/0 3/0/0 4/0/0" hw.vmm.iommu.enable=3D1 pciconf -lv gives (relevant info; with igb0 used on the host): ppt0@pci0:1:0:0:=C2=A0=C2=A0=C2=A0 class=3D0x028000 card=3D0x3099168c chip= =3D0x002a168c rev=3D0x01 hdr=3D0x00 =C2=A0=C2=A0=C2=A0 vendor=C2=A0=C2=A0=C2=A0=C2=A0 =3D 'Qualcomm Atheros' =C2=A0=C2=A0=C2=A0 device=C2=A0=C2=A0=C2=A0=C2=A0 =3D 'AR928X Wireless Net= work Adapter (PCI-Express)' =C2=A0=C2=A0=C2=A0 class=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 =3D network igb0@pci0:2:0:0:=C2=A0=C2=A0=C2=A0 class=3D0x020000 card=3D0x00008086 chip= =3D0x157b8086 rev=3D0x03 hdr=3D0x00 =C2=A0=C2=A0=C2=A0 vendor=C2=A0=C2=A0=C2=A0=C2=A0 =3D 'Intel Corporation' =C2=A0=C2=A0=C2=A0 device=C2=A0=C2=A0=C2=A0=C2=A0 =3D 'I210 Gigabit Networ= k Connection' =C2=A0=C2=A0=C2=A0 class=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 =3D network =C2=A0=C2=A0=C2=A0 subclass=C2=A0=C2=A0 =3D ethernet ppt1@pci0:3:0:0:=C2=A0=C2=A0=C2=A0 class=3D0x020000 card=3D0x00008086 chip= =3D0x157b8086 rev=3D0x03 hdr=3D0x00 =C2=A0=C2=A0=C2=A0 vendor=C2=A0=C2=A0=C2=A0=C2=A0 =3D 'Intel Corporation' =C2=A0=C2=A0=C2=A0 device=C2=A0=C2=A0=C2=A0=C2=A0 =3D 'I210 Gigabit Networ= k Connection' =C2=A0=C2=A0=C2=A0 class=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 =3D network =C2=A0=C2=A0=C2=A0 subclass=C2=A0=C2=A0 =3D ethernet ppt2@pci0:4:0:0:=C2=A0=C2=A0=C2=A0 class=3D0x020000 card=3D0x00008086 chip= =3D0x157b8086 rev=3D0x03 hdr=3D0x00 =C2=A0=C2=A0=C2=A0 vendor=C2=A0=C2=A0=C2=A0=C2=A0 =3D 'Intel Corporation' =C2=A0=C2=A0=C2=A0 device=C2=A0=C2=A0=C2=A0=C2=A0 =3D 'I210 Gigabit Networ= k Connection' =C2=A0=C2=A0=C2=A0 class=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 =3D network =C2=A0=C2=A0=C2=A0 subclass=C2=A0=C2=A0 =3D ethernet in my vm-bhyve config I have passthru0=3D"1/0/0" passthru1=3D"4/0/0" which works nicely with the i210 adapter, but not with the wifi adapter. The wifi adapter also works when not passing through and using it via the host. In the VM (tried both the 12.2-RELEASE and 13.0-RC3), I have tried to load/unload various modules (or e.g. tried dev.ath.0.hal.force_full_reset=3D1), I do not get any connections, wifi scans/lists do not work. Other configurations result in "ath0: Device timeout" or in "wlan0: CTRL-EVENT-SCAN-FAILED ret=3D-1 retry=3D1". Any ideas how to resolve that? Regards, Robert