From nobody Fri Jun 27 06:38:37 2025 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4bT5VS0FRgz60MSL for ; Fri, 27 Jun 2025 06:38:40 +0000 (UTC) (envelope-from corvink@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R11" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4bT5VR6f7Fz3Z9k; Fri, 27 Jun 2025 06:38:39 +0000 (UTC) (envelope-from corvink@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1751006319; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references:autocrypt:autocrypt; bh=VzvfA2slPsG3fpGE7J9b7Sx2QC4hNYQF417vh/ptiaw=; b=Kn9gigzgBn+areRkQPGoESLkslxLmIt1OKw8j0teT46rC1A0c4EcNSyHqrrU9O+9bDZ8Th gS2/TcpV0E4j2F7ZtN6pMUxRoV2Zs4iCF+G8F/J1MlQPNx65SVTKLXO6sja4l/u+u7JZVY itd/eDWqhSpkhamzQ+E24hXGr+x70c875f3H0kzkuZlQ5HyIp8aksdgBvoX5lif3Lhot/X PclLsyZa23DZDeky88mFgRxLO+lZ6BYrfvbQAsQphcmx9ry6Z+k8wNEa6rgOHvrpEibFaG 00OXK7R1kHqfimMsQ7wUuz5qgI3tjE02j0XmKD4sA8v5qYhVKygzFG1geVT01Q== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1751006319; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references:autocrypt:autocrypt; bh=VzvfA2slPsG3fpGE7J9b7Sx2QC4hNYQF417vh/ptiaw=; b=ICC7DfJ30ZHPMb4eYf8URLGhJAFMwl6B3n5BniNEz6nsiFW03Eav656JhGj4Y10I1iZ/9+ R9j318qTYs26AV+30LwS4rY+hqXB79ZrXN/yWwyq0ywLc3483pbijEpNaeLjSZMoDbkyBl u83jUjJKdtGgsvVad9ID//u/ZIpiEqWHvcNUbOfnOnv6wiblVlF3YX4R84EUg5em/kYxXO 8ZbIOPO2BRozqYVKeDZzbB7P8KUCq3gbiyOvKMz2AWr/d+tP/ID9lAljYmbtNmfseMzaQ+ 2eXyOu7UxMryCd6k01Ltbgh0ZTPB+Zk1gprDPLselqZbLszNcDWCud5RXnTXmw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1751006319; a=rsa-sha256; cv=none; b=Qv8SrpGHWocjqelCXKW2j0hKKd4Gx1JnEnuk+APcRav+pbafG2M8lKcyxRIQV8NEnU08aC fiuNH4KamOvTLOZyYJQVIgxzPER5HY4rClSTvGyFAxsjNhQG8yIyHMus0Tc60vcwUIjJbA +5cwTD038YMvJGxPUj527lHSC1lKVsA/A3g4BIyhj5CybqJWhFU9j78Rc84uLwZR39bjlF MH5kglmYC0C0Gq9zIjCKmXfaO6tAOLI5ApTsgZL+IcIR0uiyOl5Sbn1BVcsaihJhuASycQ Q9macFtsnd62mN+DzVLvNewdxs8CeYf5CoV/BgmQI5TXWqbI8YVKeYRspAMO4A== Received: from corvink-nb.fritz.box (unknown [IPv6:2001:9e8:dc3c:4b00:d440:3c23:c36a:a166]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (prime256v1) server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: corvink) by smtp.freebsd.org (Postfix) with ESMTPSA id 4bT5VR3cTHz178D; Fri, 27 Jun 2025 06:38:39 +0000 (UTC) (envelope-from corvink@FreeBSD.org) Message-ID: Subject: Re: bhyve: GPU passthrough for Nvidia cards From: Corvin =?ISO-8859-1?Q?K=F6hne?= To: Stephan Althaus , virtualization@freebsd.org Date: Fri, 27 Jun 2025 08:38:37 +0200 In-Reply-To: References: <4785074a005d66ed92e5670b9fa4ce45a5d65eba.camel@FreeBSD.org> Autocrypt: addr=corvink@FreeBSD.org; prefer-encrypt=mutual; keydata=mQINBGNjZaIBEADDTrDNf+0pwiuRPBdClcnZW83dH1UhuOi0u+A1J2SatEBbNaFVtXXAa vewCTuyV/ZbNidjlhq3R/pWyiKjFKvs5dj7PMCw+3z2D5OWpMdHg7TrB+fbdFPOEsu0zQVKNaO+pS KCfN0Re0m7bL3wuvl7PXvBufRwA3Guo1P4j3TXWaEkuso7VupTvE25zVGg9ONHrGOjA9RUy+Yg4Se 3NLgtUdjBgA21SBQTDvRQV4fDmVenlwvWeE0Xm8FcDcpQb6sJTihaDku78mi3Ux1HCk7rTcepVEB0 xIB6qmFxv0sLlDmVv6Z6qg1y/Q5m23Pgz60o3TulMPV4F+3Itm8ifU+wgVSzBZbD29GYkd7LKqMkF bhvfSBk+5db3vbYY5OD//+LTM5AV7e2AhXuXMvG1UNBqXqSJTTSy6KZz+qmPQO0zos0dq46p8o82l KiBEGD2Hu0p+u0OyV+MmRYo1NIBFVbOPXp2MvUVl5II0UIJ3+N9gLBmfGA+HEpVO8PnvdoT/5NQ7m 8JK1rQHzjiDub/iDPAYMqKH4C0eZ/7zO0fuY5FeRNtuNtpH1Bw/+7/5RJH7bcKkfGHHEp15FJUrGH gWNydoDLB9QBprwQc8FEldDXBjzOMXIgh6FGKLNu6DswvIPGy6M3u7DXwDakCXz+c9Ym0oFihLzZx WntrsxdswD/CwARAQABtCdDb3J2aW4gS8O2aG5lIDxjb3J2aW4ua29laG5lQGdtYWlsLmNvbT6JAl QEEwEIAD4WIQSC9FKVreba38fZT0bYVNpWMV4CagUCZArUIwIbAwUJCWYBgAULCQgHAgYVCgkICwI EFgIDAQIeAQIXgAAKCRDYVNpWMV4CalcID/44k2i/mqSSi4W6FAobSF1nFLtP/pfcRNJriWKx2UF7 cfFMKyg7Nilg7FhLb5FDB1umUW2nFfchFPTUp4FfKzgRvPzIMg4RIRcVtTpYbl3z7zs9ZXD8qS//i ibbiUG3quncm6tO2x1jLZD3ORC+8MuLGXhYQIa4O5vVF2SBHdb/U6P+wsrF+U+OpRdEdQ/4Xu9S02 kltzBGgArjcexdhUqEqW01KCCSH0+qgfN1NE+9L934ZOB+cai2b9apPbCOGuV6KcUKMj4z0RWInhl XIyMqtmhdix/P/GjrQ1REVNdp74JeweSSedM15wwc6YLMXPrtOnnExyZ1gyNFYaub+Mdo3ZQ+8386 3B0C9IlpzEW0K8bYlZrl4WBNdcMOyByETAxgQmBgP6ZFErTtaeUOH1nX2FyR6o2GLSahRgngQmnRE zScTpPbBEkMwJMDAO+rbjjGxjeKSUwD1WOfbI6QZj+MS/uBk2p08kgN7fQaCEwj6jqML/IIE+FZ9I In6TNG0hChD384VHO+YioLBno1Atgi4Q7JUWSRIHQXZW+StQajFrWPPyKQwCe1MwqpKoMpX/q8IZB lzwJgZS8ShLeFZjtzOt1jgM99TD91Neonf9OzjTSbfo7sJviSWoICMhB/MvDZjj+naMVF86uGFxnI EsjVKyBxlJd4TRHnLYPTIHFKBLQjQ29ydmluIEvDtmhuZSA8Y29ydmlua0BGcmVlQlNELm9yZz6JA lQEEwEKAD4WIQSC9FKVreba38fZT0bYVNpWMV4CagUCY2NlogIbAwUJCWYBgAULCQgHAwUVCgkICw UWAwIBAAIeAQIXgAAKCRDYVNpWMV4CavfDEACCFnXpR7H9eOgP+GJMNPtK6i9/xnqdyXi8uCZIN0h YwjN4Xzo9SMLOf4UUlQEveOB+bGqbRfHd/fGKnrlXiPd0SGpKWJC21gqL/DsIH0J8I3Whth+O8tfP WeFy0oCsvBaaGFLIrDfoIgHF9i/gqEe48xhN42weB02Z3mdR1L0d7ME/BLwS0mCXe9Zh3uHw63S6x YB3Wsjptxe/ph6TpQDUKWtRJkjC6BqXPBdThpbbfIRWmjZbp2fKEJPvtRXS14+gbUqWeJ4xCvprA3 +ae7vtrp91X775yngyW3XTw5cmDiJIjykH8+zhEIoNQXNBpFrehkQDYrcM+WoE6NGSJo+3VJvSRWh UGWDVrxdTYNkbIjmTNlkI12NINC007DiuV7OF9XHWgrbbylvuZvbODmbJRdhTFy9upAUygX1/xUAQ EIMqMiJmyTdv8i0IbZ611WElQx9XHgGeZgM6+39/laN8FwspM6gE/4NzZHIZN0LEBOerZqoF+Il6e ccQpoEWx7nb/RilJp3dUUyvkBnJWg+AJByosg857kvvmDnZ3UB+bejWpcfFvnbkiKPUBPDO7tWPb5 r2yFDpDe/Vg5x+sRbkkXGUFD6Rx0p/ZiRIneVVg8emTzhDR0IL/BZkq/uVJkdaphZli1F/31cNgf6 ZJYnjxlk86uiYSySZQR0dKLDqq7QlQ29ydmluIEvDtmhuZSA8Yy5rb2VobmVAYmVja2hvZmYuY29t PokCVAQTAQgAPhYhBIL0UpWt5trfx9lPRthU2lYxXgJqBQJkCtScAhsDBQkJZgGABQsJCAcCBhUKC QgLAgQWAgMBAh4BAheAAAoJENhU2lYxXgJqI+QQAML5PTR7KpUFV3SLG60LQJGEOHUfDmJYczxBFb IAq1U4hIbivopu1AdLty7oDDrIjCVoa2/Cy34dd99O7lhLvUmZFB/zDSUtbUg2zhDkU0YSZ11Fdrl Wzky2tFaQRgxpDvWlUP0baa3Pd4dPDRiIUI6AOSR2SL6XANk6sJh56gLVM6G8yyafGsxSyDYg6Z78 EEMFejHwB+KP2DdsahupzM+F97HeC1+bOHYxtqN+2hEkPLtQWizyumPqNg5FvZhwe7yO8V95hF3Rh uDO+9aJT+WLLvcZEb/L1bI04IvZ5FWgCLI7Levd/DuOtZI8gWapHhqGZRbXB2fuJkCoKCl6V67h/7 aWhU3LjFTsC5siJyrxPjapKcIk8a7PqZDswNCKR+24LJ5D59mPgEOnsiCCVpik1WE/kgD+rOu9dQx jpjKwuKowf4EJP1KYNkYtoy1HthzyTOqPwqXC3IUl0GVPO3xw6MhUM3irCVFruC+ecVrv85Rd37vr duT6JvgW92xjWegMsamtkDZH8Ik/cmYhH0K/qEc6OZVNea/4PTEZe0uxODJ6pbMd80AJyGqDPPVeA gWJtEIG4k6IS8XyD5v1QJtlpDVpPwP/bbFnVc3h3Oatfn8Etm1KAqYvNwyO+om2PkF1p732uapDZd LwksVmgc9s79+9pSpeP5DbIeMzhrIK Content-Type: multipart/signed; micalg="pgp-sha512"; protocol="application/pgp-signature"; boundary="=-PW8VyfKl0E1jnwIeBqx1" User-Agent: Evolution 3.56.2 List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 --=-PW8VyfKl0E1jnwIeBqx1 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Thu, 2025-06-26 at 16:49 +0200, Stephan Althaus wrote: > On 6/26/25 15:07, Corvin K=C3=B6hne wrote: > > Hi, > >=20 > > I'm currently experimenting with GPU passthrough for Nvidia cards. All = I > > have to > > do to make it work with Ubuntu guests, is setting the INTPIN register t= o any > > value instead of just 0x00. Unfortunately, I'm unfamiliar with PCI lega= cy > > interrupts and how they work. The INTLINE register is set to 0xFF > > (unconnected). > > So, is it safe to set the INTPIN register or what has to be done for it= to > > work > > as expected? > >=20 > > Any help would be appreciated. > >=20 > >=20 > Hi! >=20 > You surely mean 'newer' NVidia cards, as my GT1030 works with FreeBSD=20 > 14.2 Host and ubuntu guest, NVIdia driver 570, (and Win guest btw) > out-of-the-box, no kernel/driver modding... >=20 > Regards, >=20 > Stephan >=20 >=20 FYI, I'm working on a desktop system with an RTX A500 on 15.0-CURRENT. Ubuntu dmesg reports "NVRM: Can't find an IRQ for your NVIDIA card!" by def= ault. Setting the INTPIN register solve this issue and the card can be detected b= y the nvidia-smi command. However, as mentioned in my initial post, I'm not sure = what has to be emulated to be able to set the INTPIN in a sane way. --=20 Kind regards, Corvin --=-PW8VyfKl0E1jnwIeBqx1 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: This is a digitally signed message part -----BEGIN PGP SIGNATURE----- iQIzBAABCgAdFiEEgvRSla3m2t/H2U9G2FTaVjFeAmoFAmhePG0ACgkQ2FTaVjFe AmouZw//Tfr/DqXm4tjNioW3IYwGAgTgtxww4FMO7UmrimZNwGoYS45jbzaK1cSl cfmkgFPOhDEn4oxpzQnD9ivntBF8/lPcoVrs+dHKZ2bntaircEgDevH0qyE+Brt2 uLv2V0Kciz5CEfzCZwwc/CHwSholwP9fIDciuiPeIab1gtuqKlimpZoSduyJaP14 hkzpMNIPVNJvqdgXGi1dKn3BjNIwvMf3M7NixCCJxT+OH2eyxlwXZ1rG7VnISJQO 87/+qU8XTjPeT9FrzFtT/u6ApeM8++kBOAzbQB0V92U5HsELxq8PZyYZ0NgdtAOZ cCs5VGKopifrInrLzk7+lmsowuf0TOpLolndoFf3APDxyQ/U3gJvVnaG7mDPkgcD zWSZh5ooFfkGREPVDTym508VxjhtkUPkQPjTTA2OdGgmfm/H2IFgBzO2VsHMFhK4 umiXucOglOc63dGy0rzk55hQPB/KmTQ1AN01l5T5UG2JCfo18smQXM0+YnAg0p73 UV3BLptmxSWtQKoJA+HawKhnDpeISqcJ5FrpkejMBINRa3GuF6qFVWA44JkUZLVq 1Bkmwng8EgGmo7bNtSbaryzblLajs+5I04ymJkjJaUpejsB0zyxA8xqJVq+NHTEu pgdjKczQmRNndykRMkbK3wpwMrq6I4ZQxGaYorc86/Jk0ZlqZW4= =HlFW -----END PGP SIGNATURE----- --=-PW8VyfKl0E1jnwIeBqx1--