From nobody Thu Sep 18 00:39:01 2025 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4cRxbZ1XQLz68KlQ for ; Thu, 18 Sep 2025 00:39:22 +0000 (UTC) (envelope-from tomek@cedro.info) Received: from mail-yw1-x1134.google.com (mail-yw1-x1134.google.com [IPv6:2607:f8b0:4864:20::1134]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4cRxbY6FKJz3nb5 for ; Thu, 18 Sep 2025 00:39:16 +0000 (UTC) (envelope-from tomek@cedro.info) Authentication-Results: mx1.freebsd.org; none Received: by mail-yw1-x1134.google.com with SMTP id 00721157ae682-71d71bcab69so3542647b3.0 for ; Wed, 17 Sep 2025 17:39:16 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cedro.info; s=google; t=1758155955; x=1758760755; darn=freebsd.org; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=9FdKfEHyPT6UubcLheL4PZfT8BqljKXVRx+BPou8xmQ=; b=ZGJBrUAJYGJdOOJDklTpAKMkWbz34fdjSY0tLV4iYewv9ABW1RP87syMyXF8T0OnZq Gpu/vMlnGR/Qk2VE7BCK8RsuuLZsjjgbWB8lK/elFJV4Y0TKFAmBhqLuArQguEyp403I 1sYvrzYWYnkHNBhZcLFQ46Rk1PaCer1D/EHaJywqgRs1Ww67tcJGhzFA0y8UaQODeaHz 7Sp787vR3hksDvbSNo1TnuG9b4tBulmKD2SikGrJQs6/bt/NlTV3ugFVDigBZK2cVHKe niqw8jhp1gAsrkWqGNNlhjtp/g/a1xeBdFeyVVTF+pUD0Foy0gpOp28+1+HR+iSutE79 GDzA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1758155955; x=1758760755; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=9FdKfEHyPT6UubcLheL4PZfT8BqljKXVRx+BPou8xmQ=; b=w8oTuVN50U16erJul8e976/oDhil2JztkV3FEqTpQcPzW4WGQwxah6BFCWFAjNApgo 5v/U171WwlKcneihth8bexuExocs2Bo0dm5mbx1mt3Q5pI/aHQ2ZyZ6C4CMnDt3ng6E/ PBcm4Qr7yta5TkdDXyuQEdz7pyq9gu+btD/VBdqYwfqQxxwL+H8grOsdzHsCtiY1pXoa 1uIcbBkdGVxpSUEsnxNSWZvxRfA6PhGJ/A/t5nyty58bzZrx+BSl/CLSf09mGlnvK3Kq hXun8yKZkiii15aUzl5+4N4trWqKZGivMXqkaKk10joWWoHhbUt6X1VJ9KpaeK5Xmoc7 rzmA== X-Gm-Message-State: AOJu0YyH2u05oNCiVsIb2f+Jh8b2Ygf3n/gYfg55oyqR0B1swkipxj3N 0KnDDf8lkK/w9e4KvNFWU0yNbXB/Ip1faPyaYqPoKtjlsxr3G5hx0CuFtkuhp927cEpuc9iu5bx ludY= X-Gm-Gg: ASbGncuzb5nne/gc7KZiBI8nv69fZPVLYMiVXxuB/otRbkGl3BX7U/0GJ3lRqm25QLf DzlQ6NIATWbwSAELIPC4TRMgWbo8Tp+DtyxqmOV5vIfG7IAiELLoA+pT5EgVq6GCh/3tqNsLlVj MwSDKsCmNRxSSldK8NbA1/tPv9iTu2atFCRxV2PjL62xoIVPCdoLvkMBIgXDEn2HlKo7dO/PKSq o33H8jWl4e47wf9Prmqvt93c+ax+FfCfEDxxCll5q3XBCgNuzA+/gTtt3d0DQLn8MP0Ylz6tVYM Mg063LYdjoAIG7bMaO9LJVvQeWYOPR4tfNYVbkJokzfhxLx1lx640g0SgCd9go64hdqQXVnNsId UCeiFnIDFqnlJzvGfu1uhP+b2/Z6KpcrD6Ou5p3cwBKSGKfSOl9NlL/dYLak5OhcPCtLRCnChJs F89w== X-Google-Smtp-Source: AGHT+IEfAqq0acTBhkihX2ukveNVxry2RKuFUygZK9cpY3wSj4enL/HaM+CLy2UKnij+kfnDONhBOQ== X-Received: by 2002:a05:690c:450c:b0:729:df2d:4a20 with SMTP id 00721157ae682-7389284e762mr41127517b3.25.1758155954990; Wed, 17 Sep 2025 17:39:14 -0700 (PDT) Received: from mail-yw1-f171.google.com (mail-yw1-f171.google.com. [209.85.128.171]) by smtp.gmail.com with ESMTPSA id 00721157ae682-7397171df9asm2916387b3.31.2025.09.17.17.39.13 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Wed, 17 Sep 2025 17:39:14 -0700 (PDT) Received: by mail-yw1-f171.google.com with SMTP id 00721157ae682-71d603acc23so3465747b3.1 for ; Wed, 17 Sep 2025 17:39:13 -0700 (PDT) X-Received: by 2002:a05:690c:4588:b0:736:355c:7a0c with SMTP id 00721157ae682-7389284e59cmr39295617b3.35.1758155953479; Wed, 17 Sep 2025 17:39:13 -0700 (PDT) List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 References: <6CV-OY6BcErrWRit9jSpi6fWsYBG3E_Z3u6eTLPcz6foPAZV1gQpZYaZTR7JA_1ot5RQVqrWQaLxJFySXjspIhSbBJGxmckcDQyzxhALNus=@xyinn.org> <09-JQGKdIKMMp4u22KT_U_n7lXzFRKrK3mODyLvhee7a7pYyagqdi1mbgVTeq5QIe_ZrbGfkM4I03ocsBCj6ogh04hKyCcDdY65EtlrysuI=@xyinn.org> <6QpHOGTzqnqxLPCDMcDbChlobQw-mVGWb2BjQk-K7kyE3OjuLCCFLGn5nVpgEvlr3xaipUzLMWz1JaESXx9W6w7aXNyAXN5wbuoS8eaWkcU=@xyinn.org> In-Reply-To: <6QpHOGTzqnqxLPCDMcDbChlobQw-mVGWb2BjQk-K7kyE3OjuLCCFLGn5nVpgEvlr3xaipUzLMWz1JaESXx9W6w7aXNyAXN5wbuoS8eaWkcU=@xyinn.org> From: Tomek CEDRO Date: Thu, 18 Sep 2025 02:39:01 +0200 X-Gmail-Original-Message-ID: X-Gm-Features: AS18NWArZ3yq53xG8VfnWGZuki-rpnrZsbxg1Wpn2gYZ_Bo8VFweypXyeF_enOc Message-ID: Subject: Re: GPU Passthrough on FreeBSD 14.3 (AMD Radeon RX 6900 XT and Windows 10 Pro) To: Jonathan Vasquez Cc: "virtualization@freebsd.org" , =?UTF-8?Q?Corvin_K=C3=B6hne?= Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Rspamd-Queue-Id: 4cRxbY6FKJz3nb5 On Thu, Sep 18, 2025 at 2:05=E2=80=AFAM Jonathan Vasquez wr= ote: > Hey all, > I've done some more testing and improved my post. I pretty much got a ful= l blown gaming set up working. It has it's qwirks but definitely can play g= ames on this VM now. I no longer use RDP at all. Since passthrough is worki= ng, I just plugged in my monitor directly into the GFX card. Once you start= the bhyve VM, you will get video out at full power (- w/e performance lose= we have due to running in a VM). But I'm not getting any lag or stuttering= due to RDP/VNC stuff. Since I have a KVM, I was able to pass through my mo= bo's USB stuff to the VM which means the KVM allows me to use my keyboard/m= ouse in the VM, and I can even use Ethernet and sound as well since the KVM= has a headphone jack. So with all of that, I have everything I need to pla= y games on this VM with the AMD Radeon RX 6900 XT. The nice thing is that t= hings are just going to get better on FreeBSD from here :). Please check ou= t the info on my page again and let me know if anyone has any questions. > > I'm sure that we will get improvements in the future for: > - Resizable BAR support > - Fixing any issues with slowness with some games (probably a byproduct o= f something else going on) > - Any weird graphical/artifact issues in - some - circumstances. Although= it seems when I do get graphical issues, it's only temporary and doesn't m= ake the game completely unplayable. > > @Tomek CEDRO > > I'm not against getting this documentation into the handbook, but from my= little work on getting some documentation updates into the handbook, there= are specific guidelines that need to be followed with language used, struc= ture, etc, and there are a lot of side things that I didn't describe in my = document. All of this would probably need to be fully fleshed out and polis= hed before something of this magnitude would be accepted as an official cha= pter or section in the handbook. Although I agree that it's very valuable i= nformation and a highly sought after use case I would think.. at least it w= as for me. I was thinking this technology would be out of reach for me for = many many more years, but I'm happy that the day has finally come, and on m= y favorite OS, FreeBSD. Let's go!! Congratz! :-) Nice to see you play Cyberpunk2077 and Witcher3 that are from Poland where I live! Cyberpunk Not Dead! =3D) Jonathan, I did not find detailed information about the monitors setup for the host and the guest on your blog post: https://xyinn.org/blog/freebsd/freebsd_bhyve_gpu_passthrough_amd So you are using two GPUs on the host machine, on-board for the host, and the PCI-E for the guest? Is it possible to use both host and guest on the same GPU? I guess not because BSD uses kernel driver and that cannot be unloaded and then reloaded on the guest enter/exit and so KVM is necessary? Another question is why this will not work for Intel and Nvidia GPUs? I have onboard Intel and PCI-E RTX5070 from Nvidia :-P You can add video about this setup on your YT channel :-) Thanks for sharing the success story and hints on how to repeat! :-) Tomek ps/2: I really miss the good GPU/GFX support in bhyve, that is we could reuse existing GPU and screen for the guest with no VNC, RDP, or Passthrough+KVM :-P --=20 CeDeROM, SQ7MHZ, http://www.tomek.cedro.info