From nobody Thu Sep 18 00:44:45 2025 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4cRxk613Rfz68LLd for ; Thu, 18 Sep 2025 00:45:02 +0000 (UTC) (envelope-from peter.garshtja@ambient-md.com) Received: from mail-pf1-x42b.google.com (mail-pf1-x42b.google.com [IPv6:2607:f8b0:4864:20::42b]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4cRxk54ySWz3nrN for ; Thu, 18 Sep 2025 00:45:01 +0000 (UTC) (envelope-from peter.garshtja@ambient-md.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-pf1-x42b.google.com with SMTP id d2e1a72fcca58-7761a8a1dbcso420291b3a.1 for ; Wed, 17 Sep 2025 17:45:01 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ambient-md-com.20230601.gappssmtp.com; s=20230601; t=1758156295; x=1758761095; darn=freebsd.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=PUSLYIkmf6SKKgKj6pJ23Zuzn1UFKRT/PdHpAqVXgDA=; b=HyQgDRzk96RwOhw5IwoK1I3dxvK5naFuSsHMN7ZZRgUgEIrp257HAHdpkTb3oVD6E0 U9SzNycUuPSjrP4tsDxWCMD4RvLk307PRI+rbHGNQYPzwgIurj4AKKnMzn6mgErs380r SQz/HgiOdSotwdRLPV0kj/WnpRmMGWcxlkrQ2y5VbufPpWYsGzasizK57t5Z4pIdQpCx kJeFWxlO1RhyvvtEMyVSlB/5+XCjYAT3I+oQd8/mKW3TcZR53KyYx7qhMz4RRhJn+PEc Y2l2j7A/ikpxbwxcLMwgIVQZJLvi+4EQaDMvUrFOXm9dFMoCropMCo3k3r/FTzGGGFpz XtqQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1758156295; x=1758761095; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=PUSLYIkmf6SKKgKj6pJ23Zuzn1UFKRT/PdHpAqVXgDA=; b=LNHjXTqXFhqUESJ00jauN/ksIAebnbDDufcYMRq2vtcnZTzPxSvY1/bRi9wm2qfhQ9 Jig5CAXPoOlxACVWxKL8vIXfsrMhEPR1HPVmNU0cu+nAg6Ic/kJajsORtp5WhZQAW5Ry uqBYYXSZidWN68RCX+wKhGwU8rsUXd/AR2H3YgLiQbd/Q1hGxQZytrpr38vkUGhcJSxz sK6LpP1/ALh3w1HQ+boI36UFsOS6d+Bvio5knB3yzigewZpPkP15SuTqyDrf97BF5oIh 2b0Y0ifKoAf44CWoYEdbE4Ckdd0iKkpRagWJexHWgrQcpi97RudJVI9s3ZjQbzvULjzv XGQg== X-Forwarded-Encrypted: i=1; AJvYcCWVG7qv26ACulOFgKq9LqJ7e6zlP5RdoJ0073W/mOsELc/+uCi0a6PtYf7f2VAmDuS70sYE6mrx8IJOJ7hJxg==@freebsd.org X-Gm-Message-State: AOJu0YzElk+A3oZWelDbiOLCK1d/vYJ0s5bag354uCqS0u6R4fss9vQT KvA93oG1EEAHe0n0qddO0OLQTdkRTGEGmLAQojUlf8/9vEKBpBZX5CyR0HFhaF8B50K0SMPYckl fSKXP/1Ps91Ox0SA2WWORQWDxQT8yVgFbRD1Qla44FA== X-Gm-Gg: ASbGnctWqM8cB2Vn0WAWE7rx/84O+VlpLsRDUz5kZPDM6DunHRJVjZMYObJVsmy+6jR 0v18OHzaXLrjlcBSEc8e+FyauzWTgBf6pxMMRc5q5n9V59AX7sRi3ZdtgPRrlpD//3FDQGMx8YN qZ+QKTigCU0gUwT7OM6/nrJ+FdfWPKttQQpd993ViMvbJgJS8ApbB0kUOrp70xdKd5Jr0Acy1v8 bB5GPyq1yL3J1m/kV2KQ25b7h8= X-Google-Smtp-Source: AGHT+IGtP7XLq0zDcxWXULC2/EhWizuCaWuQVEKJ9FkhGKpXDVEAvtVdMANeasijpBUfV3rgiST2Eloo4yoR1OEzsrI= X-Received: by 2002:a05:6a20:914d:b0:252:9bf:ad8f with SMTP id adf61e73a8af0-27aa85b2627mr5221187637.33.1758156295333; Wed, 17 Sep 2025 17:44:55 -0700 (PDT) List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 References: <6CV-OY6BcErrWRit9jSpi6fWsYBG3E_Z3u6eTLPcz6foPAZV1gQpZYaZTR7JA_1ot5RQVqrWQaLxJFySXjspIhSbBJGxmckcDQyzxhALNus=@xyinn.org> <09-JQGKdIKMMp4u22KT_U_n7lXzFRKrK3mODyLvhee7a7pYyagqdi1mbgVTeq5QIe_ZrbGfkM4I03ocsBCj6ogh04hKyCcDdY65EtlrysuI=@xyinn.org> <6QpHOGTzqnqxLPCDMcDbChlobQw-mVGWb2BjQk-K7kyE3OjuLCCFLGn5nVpgEvlr3xaipUzLMWz1JaESXx9W6w7aXNyAXN5wbuoS8eaWkcU=@xyinn.org> In-Reply-To: From: peter garshtja Date: Wed, 17 Sep 2025 20:44:45 -0400 X-Gm-Features: AS18NWCRtsqcU8qYB7WlZKN2bRCHMbbZP--zyey8TO0CPTXNfR_kDKBqyT_zOcI Message-ID: Subject: Re: GPU Passthrough on FreeBSD 14.3 (AMD Radeon RX 6900 XT and Windows 10 Pro) To: Tomek CEDRO Cc: Jonathan Vasquez , virtualization@freebsd.org, =?UTF-8?Q?Corvin_K=C3=B6hne?= Content-Type: multipart/alternative; boundary="000000000000717d7b063f08a9b4" X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Rspamd-Queue-Id: 4cRxk54ySWz3nrN --000000000000717d7b063f08a9b4 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hi Jonathan, Thanks for the update. Can you try sunshine/moonlight setup? This setup will bring you to something GeForce Now service. Regards, Petru On Wed, Sep 17, 2025, 20:39 Tomek CEDRO wrote: > On Thu, Sep 18, 2025 at 2:05=E2=80=AFAM Jonathan Vasquez = wrote: > > Hey all, > > I've done some more testing and improved my post. I pretty much got a > full blown gaming set up working. It has it's qwirks but definitely can > play games on this VM now. I no longer use RDP at all. Since passthrough = is > working, I just plugged in my monitor directly into the GFX card. Once yo= u > start the bhyve VM, you will get video out at full power (- w/e performan= ce > lose we have due to running in a VM). But I'm not getting any lag or > stuttering due to RDP/VNC stuff. Since I have a KVM, I was able to pass > through my mobo's USB stuff to the VM which means the KVM allows me to us= e > my keyboard/mouse in the VM, and I can even use Ethernet and sound as wel= l > since the KVM has a headphone jack. So with all of that, I have everythin= g > I need to play games on this VM with the AMD Radeon RX 6900 XT. The nice > thing is that things are just going to get better on FreeBSD from here :)= . > Please check out the info on my page again and let me know if anyone has > any questions. > > > > I'm sure that we will get improvements in the future for: > > - Resizable BAR support > > - Fixing any issues with slowness with some games (probably a byproduct > of something else going on) > > - Any weird graphical/artifact issues in - some - circumstances. > Although it seems when I do get graphical issues, it's only temporary and > doesn't make the game completely unplayable. > > > > @Tomek CEDRO > > > > I'm not against getting this documentation into the handbook, but from > my little work on getting some documentation updates into the handbook, > there are specific guidelines that need to be followed with language used= , > structure, etc, and there are a lot of side things that I didn't describe > in my document. All of this would probably need to be fully fleshed out a= nd > polished before something of this magnitude would be accepted as an > official chapter or section in the handbook. Although I agree that it's > very valuable information and a highly sought after use case I would > think.. at least it was for me. I was thinking this technology would be o= ut > of reach for me for many many more years, but I'm happy that the day has > finally come, and on my favorite OS, FreeBSD. Let's go!! > > Congratz! :-) Nice to see you play Cyberpunk2077 and Witcher3 that are > from Poland where I live! Cyberpunk Not Dead! =3D) > > Jonathan, I did not find detailed information about the monitors setup > for the host and the guest on your blog post: > > https://xyinn.org/blog/freebsd/freebsd_bhyve_gpu_passthrough_amd > > So you are using two GPUs on the host machine, on-board for the host, > and the PCI-E for the guest? > > Is it possible to use both host and guest on the same GPU? I guess not > because BSD uses kernel driver and that cannot be unloaded and then > reloaded on the guest enter/exit and so KVM is necessary? > > Another question is why this will not work for Intel and Nvidia GPUs? > I have onboard Intel and PCI-E RTX5070 from Nvidia :-P > > You can add video about this setup on your YT channel :-) > > Thanks for sharing the success story and hints on how to repeat! :-) > > Tomek > > ps/2: I really miss the good GPU/GFX support in bhyve, that is we > could reuse existing GPU and screen for the guest with no VNC, RDP, or > Passthrough+KVM :-P > > -- > CeDeROM, SQ7MHZ, http://www.tomek.cedro.info > > --000000000000717d7b063f08a9b4 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hi Jonathan,
Thanks for the=C2=A0update.=

Can you try sunshine/mo= onlight setup?
This setup will bring you to somethin= g GeForce Now service.

R= egards,
Petru

On Wed, Sep= 17, 2025, 20:39 Tomek CEDRO <tomek@= cedro.info> wrote:
On Thu, = Sep 18, 2025 at 2:05=E2=80=AFAM Jonathan Vasquez <jon@xyinn.org> wrote= :
> Hey all,
> I've done some more testing and improved my post. I pretty much go= t a full blown gaming set up working. It has it's qwirks but definitely= can play games on this VM now. I no longer use RDP at all. Since passthrou= gh is working, I just plugged in my monitor directly into the GFX card. Onc= e you start the bhyve VM, you will get video out at full power (- w/e perfo= rmance lose we have due to running in a VM). But I'm not getting any la= g or stuttering due to RDP/VNC stuff. Since I have a KVM, I was able to pas= s through my mobo's USB stuff to the VM which means the KVM allows me t= o use my keyboard/mouse in the VM, and I can even use Ethernet and sound as= well since the KVM has a headphone jack. So with all of that, I have every= thing I need to play games on this VM with the AMD Radeon RX 6900 XT. The n= ice thing is that things are just going to get better on FreeBSD from here = :). Please check out the info on my page again and let me know if anyone ha= s any questions.
>
> I'm sure that we will get improvements in the future for:
> - Resizable BAR support
> - Fixing any issues with slowness with some games (probably a byproduc= t of something else going on)
> - Any weird graphical/artifact issues in - some - circumstances. Altho= ugh it seems when I do get graphical issues, it's only temporary and do= esn't make the game completely unplayable.
>
> @Tomek CEDRO
>
> I'm not against getting this documentation into the handbook, but = from my little work on getting some documentation updates into the handbook= , there are specific guidelines that need to be followed with language used= , structure, etc, and there are a lot of side things that I didn't desc= ribe in my document. All of this would probably need to be fully fleshed ou= t and polished before something of this magnitude would be accepted as an o= fficial chapter or section in the handbook. Although I agree that it's = very valuable information and a highly sought after use case I would think.= . at least it was for me. I was thinking this technology would be out of re= ach for me for many many more years, but I'm happy that the day has fin= ally come, and on my favorite OS, FreeBSD. Let's go!!

Congratz! :-) Nice to see you play Cyberpunk2077 and Witcher3 that are
from Poland where I live! Cyberpunk Not Dead! =3D)

Jonathan, I did not find detailed information about the monitors setup
for the host and the guest on your blog post:

https://xyinn.org/blog/fr= eebsd/freebsd_bhyve_gpu_passthrough_amd

So you are using two GPUs on the host machine, on-board for the host,
and the PCI-E for the guest?

Is it possible to use both host and guest on the same GPU? I guess not
because BSD uses kernel driver and that cannot be unloaded and then
reloaded on the guest enter/exit and so KVM is necessary?

Another question is why this will not work for Intel and Nvidia GPUs?
I have onboard Intel and PCI-E RTX5070 from Nvidia :-P

You can add video about this setup on your YT channel :-)

Thanks for sharing the success story and hints on how to repeat! :-)

Tomek

ps/2: I really miss the good GPU/GFX support in bhyve, that is we
could reuse existing GPU and screen for the guest with no VNC, RDP, or
Passthrough+KVM :-P

--
CeDeROM, SQ7MHZ, http://www.tomek.cedro.info

--000000000000717d7b063f08a9b4--