From nobody Sun Dec 17 10:43:57 2023 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4StKLl6PmHz54RJG for ; Sun, 17 Dec 2023 10:43:43 +0000 (UTC) (envelope-from Stephan.Althaus@Duedinghausen.eu) Received: from mo4-p05-ob.smtp.rzone.de (mo4-p05-ob.smtp.rzone.de [85.215.255.135]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "*.smtp.rzone.de", Issuer "Telekom Security ServerID OV Class 2 CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4StKLk4Ztmz3X2q for ; Sun, 17 Dec 2023 10:43:42 +0000 (UTC) (envelope-from Stephan.Althaus@Duedinghausen.eu) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=hoewweken.de header.s=strato-dkim-0002 header.b=oJlgx0cb; dkim=pass header.d=hoewweken.de header.s=strato-dkim-0003 header.b=vAsoRZel; spf=none (mx1.freebsd.org: domain of Stephan.Althaus@Duedinghausen.eu has no SPF policy when checking 85.215.255.135) smtp.mailfrom=Stephan.Althaus@Duedinghausen.eu; arc=pass ("strato.com:s=strato-dkim-0002:i=1"); dmarc=none ARC-Seal: i=1; a=rsa-sha256; t=1702809819; cv=none; d=strato.com; s=strato-dkim-0002; b=DBubNbH71kHOdmLlZWCgi1KxfBZHtRNhM6STji3Q3W2HwM1jOxyt1a45V3PEjklnGV QolH4ypBmPug36dblY08+Ys3wYubNwQ+dURySV2pDd7GbhXR2wU+RvLi4yjBQkzy+x91 TD4RuyGiBZg8oeJNpE7KZxj+5G82o1usJynSG8H2yt0s2Nu0dxJOFxv79Dy0YC3eTJ49 zCHxFSbSvMhpRTCz0ELanQJb+B5mJ59WHzGrUe+kMNgDPNgghMeEctLhe58JBwwgSnEj veNtnqMI9MDZMhVwVZGTTE3DL4UeBIC/H7e6vc/RLdZ5iZk6LlfsrnsaBxB0kT5FpE7X pfUQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; t=1702809819; s=strato-dkim-0002; d=strato.com; h=In-Reply-To:From:References:To:Subject:Date:Message-ID:Cc:Date:From: Subject:Sender; bh=6YIXyd122qwHhlOOvQ+X5x1Htirtr1TJmekS894GZLo=; b=XdIor6cSs7J4DMdYG9LKX0q3x5Yh1hej9KZxX/Mn/6y5oIAaTki/M4+wEt/mGXzYyG NpA7qGpATmIJpSzVegwi4Tlg+RVtWQR470lzzXA/ECD91FPeA/yUKgiQAgseypK53b3z qAwtSj0XqWH6mS1NxISsha8GndF8rj087fFvp98ijD/BMFYIT4XIo4BFLBCgP80Z0VOV 9uyyZnCdhLs01Aihcz9xFeOPPVC8x6CqDsCEKntmD/bc+wrxN+FKMSvQGfGRL3DOASkF p8ZgqJvJ9S85TIor8+rg37rsS2pt4si+h/48zzbageeqvO++9F7geXahkIkMlkB/MQ1C LhnA== ARC-Authentication-Results: i=1; strato.com; arc=none; dkim=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; t=1702809819; s=strato-dkim-0002; d=hoewweken.de; h=In-Reply-To:From:References:To:Subject:Date:Message-ID:Cc:Date:From: Subject:Sender; bh=6YIXyd122qwHhlOOvQ+X5x1Htirtr1TJmekS894GZLo=; b=oJlgx0cbRuEGAoTPZ+GURHsMaKnUe6n8Qa51F+1v2DZjtagM9YsA1fKYsGdL4OVZqk NZ3Cpn90bzuJKtCpBLhO2jZqRgX1N+CWXwr9QAXDPwm3+SEz4plAb/Dh+z77fk5dhfxS bMEIGhIePD8YJvwGwEdbWGFmz8oq/NfRQ2EPhWueUMBfwWN/hRpyR/91UtoZFoTkH5YA rc/gIwZvaLVcs2HZEtDLVbZimM1NdUFYANKtR+wHp7QLoFkl7rz2falKfoJXaQcxy4zN FXabeNWnZ6SAA9ADpDAqOSvpf6J7L0+bX/4aitdsg9DAGy88dwnKYpvUzSomdQoioR1g yLaw== DKIM-Signature: v=1; a=ed25519-sha256; c=relaxed/relaxed; t=1702809819; s=strato-dkim-0003; d=hoewweken.de; h=In-Reply-To:From:References:To:Subject:Date:Message-ID:Cc:Date:From: Subject:Sender; bh=6YIXyd122qwHhlOOvQ+X5x1Htirtr1TJmekS894GZLo=; b=vAsoRZelTuKrml3BuRW1aAPTvQu9zW6qD5q9QQUYFmWfYI2Qrje+UCw2MWolg1U4ij aKRbGjwUSIJnjP72TqDg== X-RZG-AUTH: ":O2kGeEG7b/pS1EW2TmikjLDsYYueHLp2aWg0q38nsxN1mOntnRORP93PLpfReKNjbyYtOAegfjheaQ4=" X-RZG-CLASS-ID: mo05 Received: from www.duedinghausen.eu by smtp.strato.de (RZmta 49.10.0 DYNA|AUTH) with ESMTPSA id 9f0670zBHAhc9cb (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256 bits)) (Client did not present a certificate) for ; Sun, 17 Dec 2023 11:43:38 +0100 (CET) Received: from [192.168.2.63] (speedport.ip [192.168.1.1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (secp384r1) server-digest SHA384) (No client certificate requested) (Authenticated sender: steven) by www.duedinghausen.eu (Postfix) with ESMTPSA id C8C28128D53 for ; Sun, 17 Dec 2023 11:43:11 +0100 (CET) Content-Type: multipart/alternative; boundary="------------jPqWSJHhWwUCl8wa02J3QDLU" Message-ID: Date: Sun, 17 Dec 2023 11:43:57 +0100 List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: bhyve nvidia gtx-1650 mobile passthru on win11 Content-Language: en-US To: virtualization@freebsd.org References: From: Stephan Althaus In-Reply-To: Content-Transfer-Encoding: 8bit X-Spamd-Result: default: False [-4.29 / 15.00]; ARC_ALLOW(-1.00)[strato.com:s=strato-dkim-0002:i=1]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.995]; R_DKIM_ALLOW(-0.20)[hoewweken.de:s=strato-dkim-0002,hoewweken.de:s=strato-dkim-0003]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; XM_UA_NO_VERSION(0.01)[]; R_SPF_NA(0.00)[no SPF record]; MLMMJ_DEST(0.00)[virtualization@freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; ASN(0.00)[asn:6724, ipnet:85.215.255.0/24, country:DE]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_COUNT_TWO(0.00)[2]; DKIM_TRACE(0.00)[hoewweken.de:+]; DMARC_NA(0.00)[duedinghausen.eu]; RCPT_COUNT_ONE(0.00)[1]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; RCVD_TLS_ALL(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[virtualization@freebsd.org]; RCVD_VIA_SMTP_AUTH(0.00)[] X-Rspamd-Queue-Id: 4StKLk4Ztmz3X2q X-Spamd-Bar: ---- This is a multi-part message in MIME format. --------------jPqWSJHhWwUCl8wa02J3QDLU Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit On 12/16/23 18:49, Mario Marietto wrote: > for sure you can use nVidia gpu on the host and the intel one on the > windows 11 vm. > > Il sab 16 dic 2023, 18:11 Nuno Teixeira ha scritto: > > It seems that nvidia passtrhu isn't working (yet). > > Related to intel integrated graphics, I don't know if I can use it > for ppt since it is in use by freebsd. > Other thing, if I boot with BIOS on nvidia dedicated then intel > doesn't show up in pciconf... > > Mario Marietto escreveu no dia sábado, > 16/12/2023 à(s) 16:34: > > Are you trying to pass the nvidia gpu to windows vm ? or your > intel gpu ? > > Il sab 16 dic 2023, 17:07 Nuno Teixeira > ha scritto: > > Hello all, > > Specs: > - laptop with integrated intel + dedicated nvidia > - 15-CURRENT 3b1904d9eb04 amd64 > - win11 with nvme and tpm > > I'm sharing my results with nvidia passthru: > ### > /boot/loader.conf.local: > vmm_load="YES" > pptdevs="1/0/0 1/0/1" > > ppt0@pci0:1:0:0:        class=0x030000 rev=0xa1 hdr=0x00 > vendor=0x10de device=0x1f99 subvendor=0x17aa subdevice=0x3fa5 >     vendor     = 'NVIDIA Corporation' >     device     = 'TU117M [GeForce GTX 1650 Mobile / Max-Q]' >     class      = display >     subclass   = VGA > ppt1@pci0:1:0:1:        class=0x040300 rev=0xa1 hdr=0x00 > vendor=0x10de device=0x10fa subvendor=0x17aa subdevice=0x3ffb >     vendor     = 'NVIDIA Corporation' >     class      = multimedia >     subclass   = HDA > > bhyve: > -s 6:0,passthru,1/0/0 -s 6:1,passthru,1/0/1 > ### > > - Installed nvidia drivers without problems > - graphic card is detected but is deactivated with a > triangle and a "!": >   "Windows stopped this device... code 43" > - hda is detected and shows no problem > > I've read that some nvidia cards are working... > Any tips are welcome. > > Not sure if it is possible to use intel integrated as it > is already in use by OS. > > Thanks, > > -- > Nuno Teixeira > FreeBSD Committer (ports) > > > > -- > Nuno Teixeira > FreeBSD Committer (ports) > Hello! i had just the same, here on illumos. i didn't get it to work, but i had a similar problem with an AMD card :-/ i think i will try it again in Jan/2024, and then with a fresh install of windows... Do you use UEFI boot on both host and vm? Regards, Stephan --------------jPqWSJHhWwUCl8wa02J3QDLU Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: 8bit
On 12/16/23 18:49, Mario Marietto wrote:
for sure you can use nVidia gpu on the host and the intel one on the windows 11 vm.

Il sab 16 dic 2023, 18:11 Nuno Teixeira <eduardo@freebsd.org> ha scritto:
It seems that nvidia passtrhu isn't working (yet).

Related to intel integrated graphics, I don't know if I can use it for ppt since it is in use by freebsd.
Other thing, if I boot with BIOS on nvidia dedicated then intel doesn't show up in pciconf...

Mario Marietto <marietto2008@gmail.com> escreveu no dia sábado, 16/12/2023 à(s) 16:34:
Are you trying to pass the nvidia gpu to windows vm ? or your intel gpu ?

Il sab 16 dic 2023, 17:07 Nuno Teixeira <eduardo@freebsd.org> ha scritto:
Hello all,

Specs:
- laptop with integrated intel + dedicated nvidia
- 15-CURRENT 3b1904d9eb04 amd64
- win11 with nvme and tpm

I'm sharing my results with nvidia passthru:
###
/boot/loader.conf.local:
vmm_load="YES"
pptdevs="1/0/0 1/0/1"

ppt0@pci0:1:0:0:        class=0x030000 rev=0xa1 hdr=0x00 vendor=0x10de device=0x1f99 subvendor=0x17aa subdevice=0x3fa5
    vendor     = 'NVIDIA Corporation'
    device     = 'TU117M [GeForce GTX 1650 Mobile / Max-Q]'
    class      = display
    subclass   = VGA
ppt1@pci0:1:0:1:        class=0x040300 rev=0xa1 hdr=0x00 vendor=0x10de device=0x10fa subvendor=0x17aa subdevice=0x3ffb
    vendor     = 'NVIDIA Corporation'
    class      = multimedia
    subclass   = HDA

bhyve:
-s 6:0,passthru,1/0/0 -s 6:1,passthru,1/0/1
###

- Installed nvidia drivers without problems
- graphic card is detected but is deactivated with a triangle and a "!":
  "Windows stopped this device... code 43"
- hda is detected and shows no problem

I've read that some nvidia cards are working...
Any tips are welcome.

Not sure if it is possible to use intel integrated as it is already in use by OS.

Thanks,

--
Nuno Teixeira
FreeBSD Committer (ports)


--
Nuno Teixeira
FreeBSD Committer (ports)

Hello!

i had just the same, here on illumos.
i didn't get it to work, but i had a similar problem with an AMD card :-/

i think i will try it again in Jan/2024, and then with a fresh install of windows...

Do you use UEFI boot on both host and vm?

Regards,
Stephan


--------------jPqWSJHhWwUCl8wa02J3QDLU-- From nobody Sun Dec 17 10:51:23 2023 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4StKXN3hzLz54S6F for ; Sun, 17 Dec 2023 10:52:04 +0000 (UTC) (envelope-from marietto2008@gmail.com) Received: from mail-lf1-x12f.google.com (mail-lf1-x12f.google.com [IPv6:2a00:1450:4864:20::12f]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4StKXM3pM0z4Fj3 for ; Sun, 17 Dec 2023 10:52:03 +0000 (UTC) (envelope-from marietto2008@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-lf1-x12f.google.com with SMTP id 2adb3069b0e04-50e18689828so2308922e87.2 for ; Sun, 17 Dec 2023 02:52:03 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1702810320; x=1703415120; darn=freebsd.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=Jm1fxu/ODAqKqarnmMChB5oS2iodAoQUcO74SwtM1sE=; b=KTuYIy+2Mzo96sxxA6mB83gMOCyYLe4k/Id9C51nq2tSVRRzJ62YlLkGsLtSWlUSJ6 Z3ny9Cmx7LYa7RlvL0a+MCrzki4cekT5ZA00Nm1U9bGpb0IUCNREqd3rzNBxuNfd1fOd srcn1MoQYD+AeMz0b/RmPhxd9darLyDp/3m/emLS2dw7OpAwLYLP8xpCf4fUqM3rijTY IK+BBhMSKnUEW+Xs6t8VEPG4TGQWFnx7OHvq3R9zmyLWewSSJJ5/bQaCs6bdX/8aURh9 giJc11kQagoTteV4uiFxflZkK96w+1TVKJIkpc61s+5OLAIvWVpKcR1w2TBa/FPdYSDC CdHQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1702810320; x=1703415120; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=Jm1fxu/ODAqKqarnmMChB5oS2iodAoQUcO74SwtM1sE=; b=YZGOMlCSOR7hKgLItAmFY9mLkjtx6n6f4QA/WWiQchkcpzv1RJ79iK/b9S9vGrYN8Y BqTOS+BEwvGI5V0Sp1Lzi/wI6aS/QAv9WgPe9fNu1nXVco6eop6Ik4slapjA+zZmIOLi kbqg+hXbm9Hb86x4tEL4IYH5NUArDG07jrr1N0m9Ytwvy3MlH6VwLeCus+bhAWZeeV/I qEwjTZm5Vo1+Df5nJc3X2f4QGnmgAP8DCwkplE6MOT0URZivss2r2/JBlqyp/iK9fcRl ZlxrhJkb9KvoC1evL1TMoj9CkDwqnGChWoMBK9PuLMjJNf878N6IvQWQEmlurHqfj4bF 43Yw== X-Gm-Message-State: AOJu0Yz6CzOpToDhYxBlIu4bJViU8P5kJuM/CQKZDjVZ3PlTwz584i+c xQ2UFswsLiemtXc9cZoujIeCF+r4eUmPLhJiPxeMjIPchgE= X-Google-Smtp-Source: AGHT+IFCF1WBtcUiiU8T9hYqYnyg90rcscbKdvjqgAw9iiD9WmItZswFgVRrx/AnomGmgjq2l6sDuYnLdJsnb5ySJLI= X-Received: by 2002:a05:6512:3093:b0:50e:16c9:ccf6 with SMTP id z19-20020a056512309300b0050e16c9ccf6mr3047342lfd.10.1702810319563; Sun, 17 Dec 2023 02:51:59 -0800 (PST) List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Mario Marietto Date: Sun, 17 Dec 2023 11:51:23 +0100 Message-ID: Subject: Re: bhyve nvidia gtx-1650 mobile passthru on win11 To: Stephan Althaus Cc: virtualization@freebsd.org Content-Type: multipart/alternative; boundary="00000000000037b07a060cb26cb0" X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] X-Spamd-Bar: ---- X-Rspamd-Queue-Id: 4StKXM3pM0z4Fj3 --00000000000037b07a060cb26cb0 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable AMD gpu works great with bhyve and they are recognized by a Windows vm. On Sun, Dec 17, 2023 at 11:43=E2=80=AFAM Stephan Althaus < Stephan.Althaus@duedinghausen.eu> wrote: > On 12/16/23 18:49, Mario Marietto wrote: > > for sure you can use nVidia gpu on the host and the intel one on the > windows 11 vm. > > Il sab 16 dic 2023, 18:11 Nuno Teixeira ha scritto: > >> It seems that nvidia passtrhu isn't working (yet). >> >> Related to intel integrated graphics, I don't know if I can use it for >> ppt since it is in use by freebsd. >> Other thing, if I boot with BIOS on nvidia dedicated then intel doesn't >> show up in pciconf... >> >> Mario Marietto escreveu no dia s=C3=A1bado, >> 16/12/2023 =C3=A0(s) 16:34: >> >>> Are you trying to pass the nvidia gpu to windows vm ? or your intel gpu= ? >>> >>> Il sab 16 dic 2023, 17:07 Nuno Teixeira ha >>> scritto: >>> >>>> Hello all, >>>> >>>> Specs: >>>> - laptop with integrated intel + dedicated nvidia >>>> - 15-CURRENT 3b1904d9eb04 amd64 >>>> - win11 with nvme and tpm >>>> >>>> I'm sharing my results with nvidia passthru: >>>> ### >>>> /boot/loader.conf.local: >>>> vmm_load=3D"YES" >>>> pptdevs=3D"1/0/0 1/0/1" >>>> >>>> ppt0@pci0:1:0:0: class=3D0x030000 rev=3D0xa1 hdr=3D0x00 vendor= =3D0x10de >>>> device=3D0x1f99 subvendor=3D0x17aa subdevice=3D0x3fa5 >>>> vendor =3D 'NVIDIA Corporation' >>>> device =3D 'TU117M [GeForce GTX 1650 Mobile / Max-Q]' >>>> class =3D display >>>> subclass =3D VGA >>>> ppt1@pci0:1:0:1: class=3D0x040300 rev=3D0xa1 hdr=3D0x00 vendor= =3D0x10de >>>> device=3D0x10fa subvendor=3D0x17aa subdevice=3D0x3ffb >>>> vendor =3D 'NVIDIA Corporation' >>>> class =3D multimedia >>>> subclass =3D HDA >>>> >>>> bhyve: >>>> -s 6:0,passthru,1/0/0 -s 6:1,passthru,1/0/1 >>>> ### >>>> >>>> - Installed nvidia drivers without problems >>>> - graphic card is detected but is deactivated with a triangle and a "!= ": >>>> "Windows stopped this device... code 43" >>>> - hda is detected and shows no problem >>>> >>>> I've read that some nvidia cards are working... >>>> Any tips are welcome. >>>> >>>> Not sure if it is possible to use intel integrated as it is already in >>>> use by OS. >>>> >>>> Thanks, >>>> >>>> -- >>>> Nuno Teixeira >>>> FreeBSD Committer (ports) >>>> >>> >> >> -- >> Nuno Teixeira >> FreeBSD Committer (ports) >> > Hello! > > i had just the same, here on illumos. > i didn't get it to work, but i had a similar problem with an AMD card :-/ > > i think i will try it again in Jan/2024, and then with a fresh install of > windows... > > Do you use UEFI boot on both host and vm? > > Regards, > Stephan > > > --=20 Mario. --00000000000037b07a060cb26cb0 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
AMD gpu works great with bhyve and they are recognized by = a Windows vm.

On Sun, Dec 17, 2023 at 11:43=E2=80=AFAM Stephan Althaus = <Stephan.Althaus@due= dinghausen.eu> wrote:
=20 =20 =20
On 12/16/23 18:49, Mario Marietto wrote:
=20
for sure you can use nVidia gpu on the host and the intel one on the windows 11 vm.

Il sab 16 dic 2023, 18:11 Nun= o Teixeira <eduardo@freebsd.org> ha scritto:
It seems that nvidia passtrhu isn't working (yet).

Related to intel integrated graphics, I don't know if = I can use it for ppt since it is in use by freebsd.
Other thing, if I boot with BIOS on nvidia dedicated then intel doesn't show up in pciconf...

Mario Marietto <ma= rietto2008@gmail.com> escreveu no dia s=C3=A1bado, 16/12/2023 =C3=A0(s) 16:34:
Are you trying to pass the nvidia gpu to windows vm ? or your intel gpu ?

Il sab 16 dic 2023, 17:07 Nuno Teixeira <eduardo@freebsd.org> ha scritto:
Hello all,

Specs:
- laptop with integrated intel + dedicated nvidia
- 15-CURRENT 3b1904d9eb04 amd64
- win11 with nvme and tpm

I'm sharing my results with nvidia passthru:
###
/boot/loader.conf.local:
vmm_load=3D"YES"
pptdevs=3D"1/0/0 1/0/1"

ppt0@pci0:1:0:0: =C2=A0 =C2=A0 =C2=A0 =C2=A0clas= s=3D0x030000 rev=3D0xa1 hdr=3D0x00 vendor=3D0x10de device=3D0x1f= 99 subvendor=3D0x17aa subdevice=3D0x3fa5
=C2=A0 =C2=A0 vendor =C2=A0 =C2=A0 =3D 'NVIDIA = Corporation'
=C2=A0 =C2=A0 device =C2=A0 =C2=A0 =3D 'TU117M = [GeForce GTX 1650 Mobile / Max-Q]'
=C2=A0 =C2=A0 class =C2=A0 =C2=A0 =C2=A0=3D display=
=C2=A0 =C2=A0 subclass =C2=A0 =3D VGA
ppt1@pci0:1:0:1: =C2=A0 =C2=A0 =C2=A0 =C2=A0class= =3D0x040300 rev=3D0xa1 hdr=3D0x00 vendor=3D0x10de device=3D0x10fa subvendor=3D0x17aa subdevice=3D0x3ffb
=C2=A0 =C2=A0 vendor =C2=A0 =C2=A0 =3D 'NVIDIA = Corporation'
=C2=A0 =C2=A0 class =C2=A0 =C2=A0 =C2=A0=3D multime= dia
=C2=A0 =C2=A0 subclass =C2=A0 =3D HDA

bhyve:
-s 6:0,passthru,1/0/0 -s 6:1,passthru,1/0/1
###

- Installed nvidia drivers without problems
- graphic card is detected but is deactivated with a triangle and a "!":
=C2=A0 "Windows stopped this device... code= 43"
- hda is detected and shows no problem

I've read that some nvidia cards are working...
Any tips are welcome.

Not sure if it is possible to use intel integrated as it is already in use by OS.

Thanks,

--
Nuno Teixeira
FreeBSD Committer (ports)


--
Nuno Teixeira
FreeBSD Committer (ports)

Hello!

i had just the same, here on illumos.
i didn't get it to work, but i had a similar problem with an AMD card :-/

i think i will try it again in Jan/2024, and then with a fresh install of windows...

Do you use UEFI boot on both host and vm?

Regards,
Stephan




--
Mario.
--00000000000037b07a060cb26cb0-- From nobody Sun Dec 17 10:54:45 2023 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4StKbB4FsSz54S2r for ; Sun, 17 Dec 2023 10:54:30 +0000 (UTC) (envelope-from Stephan.Althaus@Duedinghausen.eu) Received: from mo4-p05-ob.smtp.rzone.de (mo4-p05-ob.smtp.rzone.de [81.169.146.181]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "*.smtp.rzone.de", Issuer "Telekom Security ServerID OV Class 2 CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4StKb925Bfz4J8Z for ; Sun, 17 Dec 2023 10:54:29 +0000 (UTC) (envelope-from Stephan.Althaus@Duedinghausen.eu) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=hoewweken.de header.s=strato-dkim-0002 header.b=ofo47C6t; dkim=pass header.d=hoewweken.de header.s=strato-dkim-0003 header.b=BdrAc3m9; spf=none (mx1.freebsd.org: domain of Stephan.Althaus@Duedinghausen.eu has no SPF policy when checking 81.169.146.181) smtp.mailfrom=Stephan.Althaus@Duedinghausen.eu; arc=pass ("strato.com:s=strato-dkim-0002:i=1"); dmarc=none ARC-Seal: i=1; a=rsa-sha256; t=1702810467; cv=none; d=strato.com; s=strato-dkim-0002; b=psLg6HNAlp+Kt9rutk0sJw4oIJX2XzcH0rvH+2rghf4lB4yw14+aWwjnU/L/P65C0J /P4bJNptsW/46EmrsphH9QRH/fjeAN8xCD9u/T5Z01iRba4XUo8OMKaeXcHMsEtqLyfF Gg/re1Hj7oH3Yup61Fmn57AkQw/dW2NePonMyaaFHRH6Vorq/tnoFMO8ejw0aU8rE6kl XwVSOi/cR63HXSujEUxXYGDBNLd1xhZNbzKAhKuFdxww2P6X2IWGnJvww4uqkdIyhDcR XeoJlrHp3ewjYHDRPlnpcf0Q61IUo1zsdpSojUOIG5RB0WRt2niah9KpULCscmCUeZvI nc5Q== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; t=1702810467; s=strato-dkim-0002; d=strato.com; h=In-Reply-To:From:References:To:Subject:Date:Message-ID:Cc:Date:From: Subject:Sender; bh=FzrMUqLDzy4yiMzrp7SUA+K5Mr5Z+hd2DxkZ5DV/OBE=; b=ZFBbGTTBae7eK+1Rgp+U+ct3qDR9HitUpwtXOst+egK7X/V4YVyWulKIUdBvI7GK8l a41bYJika/QH79xrb38tDSZ8ujCcXGwaGJj/UKdb2/flq0BizhPBnoroAyFo3A/q6Y6w 6S0g3vcxIxPP+L9T7r4d2Ib8ovNN4/sfTnX+c7AvWx0tISvVCaIwicaG+4Jv3sDfCQbO fyAi7PMVMpnGTmh8W1elegP2h/VnnUTO0hmCyka916jTcuCeON8gkr/jrh9Gout9OJSJ 7hDGTnjHV1gUWhw72ipCYiAr/IfoY5RbBu8K2DNOvjvyP8nox3x0+IkgGv7d1M5m1Gox xURw== ARC-Authentication-Results: i=1; strato.com; arc=none; dkim=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; t=1702810467; s=strato-dkim-0002; d=hoewweken.de; h=In-Reply-To:From:References:To:Subject:Date:Message-ID:Cc:Date:From: Subject:Sender; bh=FzrMUqLDzy4yiMzrp7SUA+K5Mr5Z+hd2DxkZ5DV/OBE=; b=ofo47C6tN5tOl1q8qGgwao8oltqJ/r88R//1n+g8G+Io2yi1vpcP0HNBgAuClwN5u6 8/Qaz8zsJr0aOIEZfQuAmUl55a9aak7hD9T7BSWsQiOMyZ5PvUr9YJHgM6kBw0kFXVlg zQ26ufYxMwzEj53HT6xWfV1HXaPe5b73jLyI6BXsx8AmFdWrZogawjb9BON/8QIfY+tx 8Wu/j1z83S2ZScDEanY/owHSrOYCncA3of1AnRRJBJCou5scylXwIBc+900n0kOm8vMK r8bWK0iXqVMbDuD4DhzQiFWUXnb4H0tvPRikEoyAxAPLhJO9SoiPqt69wD9EY1UNMBZb EHRw== DKIM-Signature: v=1; a=ed25519-sha256; c=relaxed/relaxed; t=1702810467; s=strato-dkim-0003; d=hoewweken.de; h=In-Reply-To:From:References:To:Subject:Date:Message-ID:Cc:Date:From: Subject:Sender; bh=FzrMUqLDzy4yiMzrp7SUA+K5Mr5Z+hd2DxkZ5DV/OBE=; b=BdrAc3m9j7sfrg8vRcxO6qhM64HMPGUhxJWGhZGahALRA+VSBnsN5MOcdgm+C+YG66 Vb6YVrur3pUQwoHlKqCw== X-RZG-AUTH: ":O2kGeEG7b/pS1EW2TmikjLDsYYueHLp2aWg0q38nsxN1mOntnRORP93PLpfReKNjbyYtOAegfjheaQ4=" X-RZG-CLASS-ID: mo05 Received: from www.duedinghausen.eu by smtp.strato.de (RZmta 49.10.0 DYNA|AUTH) with ESMTPSA id 9f0670zBHAsR9dk (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256 bits)) (Client did not present a certificate) for ; Sun, 17 Dec 2023 11:54:27 +0100 (CET) Received: from [192.168.2.63] (speedport.ip [192.168.1.1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (secp384r1) server-digest SHA384) (No client certificate requested) (Authenticated sender: steven) by www.duedinghausen.eu (Postfix) with ESMTPSA id D99C7128F46 for ; Sun, 17 Dec 2023 11:53:59 +0100 (CET) Content-Type: multipart/alternative; boundary="------------YLc0z8WjOCxOpuKVHfuUxRNl" Message-ID: Date: Sun, 17 Dec 2023 11:54:45 +0100 List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: bhyve nvidia gtx-1650 mobile passthru on win11 Content-Language: en-US To: virtualization@freebsd.org References: From: Stephan Althaus In-Reply-To: Content-Transfer-Encoding: 8bit X-Spamd-Result: default: False [-4.39 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; ARC_ALLOW(-1.00)[strato.com:s=strato-dkim-0002:i=1]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.995]; R_DKIM_ALLOW(-0.20)[hoewweken.de:s=strato-dkim-0002,hoewweken.de:s=strato-dkim-0003]; RCVD_IN_DNSWL_LOW(-0.10)[81.169.146.181:from]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; XM_UA_NO_VERSION(0.01)[]; MLMMJ_DEST(0.00)[virtualization@freebsd.org]; ASN(0.00)[asn:6724, ipnet:81.169.144.0/22, country:DE]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; R_SPF_NA(0.00)[no SPF record]; DKIM_TRACE(0.00)[hoewweken.de:+]; RCPT_COUNT_ONE(0.00)[1]; RCVD_TLS_ALL(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; DMARC_NA(0.00)[duedinghausen.eu]; MID_RHS_MATCH_FROM(0.00)[]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[virtualization@freebsd.org]; RCVD_VIA_SMTP_AUTH(0.00)[] X-Rspamd-Queue-Id: 4StKb925Bfz4J8Z X-Spamd-Bar: ---- This is a multi-part message in MIME format. --------------YLc0z8WjOCxOpuKVHfuUxRNl Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit On 12/17/23 11:51, Mario Marietto wrote: > AMD gpu works great with bhyve and they are recognized by a Windows vm. > > On Sun, Dec 17, 2023 at 11:43 AM Stephan Althaus > wrote: > > On 12/16/23 18:49, Mario Marietto wrote: >> for sure you can use nVidia gpu on the host and the intel one on >> the windows 11 vm. >> >> Il sab 16 dic 2023, 18:11 Nuno Teixeira ha >> scritto: >> >> It seems that nvidia passtrhu isn't working (yet). >> >> Related to intel integrated graphics, I don't know if I can >> use it for ppt since it is in use by freebsd. >> Other thing, if I boot with BIOS on nvidia dedicated then >> intel doesn't show up in pciconf... >> >> Mario Marietto escreveu no dia >> sábado, 16/12/2023 à(s) 16:34: >> >> Are you trying to pass the nvidia gpu to windows vm ? or >> your intel gpu ? >> >> Il sab 16 dic 2023, 17:07 Nuno Teixeira >> ha scritto: >> >> Hello all, >> >> Specs: >> - laptop with integrated intel + dedicated nvidia >> - 15-CURRENT 3b1904d9eb04 amd64 >> - win11 with nvme and tpm >> >> I'm sharing my results with nvidia passthru: >> ### >> /boot/loader.conf.local: >> vmm_load="YES" >> pptdevs="1/0/0 1/0/1" >> >> ppt0@pci0:1:0:0:  class=0x030000 rev=0xa1 hdr=0x00 >> vendor=0x10de device=0x1f99 subvendor=0x17aa >> subdevice=0x3fa5 >>     vendor     = 'NVIDIA Corporation' >>     device     = 'TU117M [GeForce GTX 1650 Mobile / >> Max-Q]' >>     class      = display >>     subclass   = VGA >> ppt1@pci0:1:0:1:        class=0x040300 rev=0xa1 >> hdr=0x00 vendor=0x10de device=0x10fa subvendor=0x17aa >> subdevice=0x3ffb >>     vendor     = 'NVIDIA Corporation' >>     class      = multimedia >>     subclass   = HDA >> >> bhyve: >> -s 6:0,passthru,1/0/0 -s 6:1,passthru,1/0/1 >> ### >> >> - Installed nvidia drivers without problems >> - graphic card is detected but is deactivated with a >> triangle and a "!": >>   "Windows stopped this device... code 43" >> - hda is detected and shows no problem >> >> I've read that some nvidia cards are working... >> Any tips are welcome. >> >> Not sure if it is possible to use intel integrated as >> it is already in use by OS. >> >> Thanks, >> >> -- >> Nuno Teixeira >> FreeBSD Committer (ports) >> >> >> >> -- >> Nuno Teixeira >> FreeBSD Committer (ports) >> > Hello! > > i had just the same, here on illumos. > i didn't get it to work, but i had a similar problem with an AMD > card :-/ > > i think i will try it again in Jan/2024, and then with a fresh > install of windows... > > Do you use UEFI boot on both host and vm? > > Regards, > Stephan > > > > > -- > Mario. Ok i will give it a try again :-) Thanks for confirmation! ...for the fault on my side :-) --------------YLc0z8WjOCxOpuKVHfuUxRNl Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: 8bit
On 12/17/23 11:51, Mario Marietto wrote:
AMD gpu works great with bhyve and they are recognized by a Windows vm.

On Sun, Dec 17, 2023 at 11:43 AM Stephan Althaus <Stephan.Althaus@duedinghausen.eu> wrote:
On 12/16/23 18:49, Mario Marietto wrote:
for sure you can use nVidia gpu on the host and the intel one on the windows 11 vm.

Il sab 16 dic 2023, 18:11 Nuno Teixeira <eduardo@freebsd.org> ha scritto:
It seems that nvidia passtrhu isn't working (yet).

Related to intel integrated graphics, I don't know if I can use it for ppt since it is in use by freebsd.
Other thing, if I boot with BIOS on nvidia dedicated then intel doesn't show up in pciconf...

Mario Marietto <marietto2008@gmail.com> escreveu no dia sábado, 16/12/2023 à(s) 16:34:
Are you trying to pass the nvidia gpu to windows vm ? or your intel gpu ?

Il sab 16 dic 2023, 17:07 Nuno Teixeira <eduardo@freebsd.org> ha scritto:
Hello all,

Specs:
- laptop with integrated intel + dedicated nvidia
- 15-CURRENT 3b1904d9eb04 amd64
- win11 with nvme and tpm

I'm sharing my results with nvidia passthru:
###
/boot/loader.conf.local:
vmm_load="YES"
pptdevs="1/0/0 1/0/1"

ppt0@pci0:1:0:0:        class=0x030000 rev=0xa1 hdr=0x00 vendor=0x10de device=0x1f99 subvendor=0x17aa subdevice=0x3fa5
    vendor     = 'NVIDIA Corporation'
    device     = 'TU117M [GeForce GTX 1650 Mobile / Max-Q]'
    class      = display
    subclass   = VGA
ppt1@pci0:1:0:1:        class=0x040300 rev=0xa1 hdr=0x00 vendor=0x10de device=0x10fa subvendor=0x17aa subdevice=0x3ffb
    vendor     = 'NVIDIA Corporation'
    class      = multimedia
    subclass   = HDA

bhyve:
-s 6:0,passthru,1/0/0 -s 6:1,passthru,1/0/1
###

- Installed nvidia drivers without problems
- graphic card is detected but is deactivated with a triangle and a "!":
  "Windows stopped this device... code 43"
- hda is detected and shows no problem

I've read that some nvidia cards are working...
Any tips are welcome.

Not sure if it is possible to use intel integrated as it is already in use by OS.

Thanks,

--
Nuno Teixeira
FreeBSD Committer (ports)


--
Nuno Teixeira
FreeBSD Committer (ports)

Hello!

i had just the same, here on illumos.
i didn't get it to work, but i had a similar problem with an AMD card :-/

i think i will try it again in Jan/2024, and then with a fresh install of windows...

Do you use UEFI boot on both host and vm?

Regards,
Stephan




--
Mario.

Ok i will give it a try again :-)

Thanks for confirmation!

...for the fault on my side :-)


--------------YLc0z8WjOCxOpuKVHfuUxRNl-- From nobody Sun Dec 17 12:28:29 2023 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4StMgs3t3zz54YK4 for ; Sun, 17 Dec 2023 12:28:41 +0000 (UTC) (envelope-from eduardo@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4StMgs1nFbz4Nk2 for ; Sun, 17 Dec 2023 12:28:41 +0000 (UTC) (envelope-from eduardo@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1702816121; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=dRnpOMxYa/jTfcJGtkOGBVbfo/3sccWYgbK4+8GdQ9Y=; b=dirQd/QniWun34p97vRWLK3GLpZydoITv1pfSJ1oX5zhyrKl+vGAZIJtvTUi+M/LjXxaBc BOKx985NiJnvWk/1MJSpKdrvm0A7N3vLJXoqgjS5m8Y4t4MIgYS+IC7hiYZtw1dgOqKhew ZdQZpklgGNWjXmqTWJLMjPMwXo0VxesPnQ8y49HTwBI12/rE75GCOyjm4bg5hraO1FPdTE hPIbBu52cMEzb6bFqiHEX4Of4w54KXogfqs44PSSpa86L3TEqb6C4gPrhheQiO2hit0Cmx v4MmnZSUC0FJHKezlcxIi4ObzMbspvgEj8d2uvpm5j/38JJ2mdiVDnX1PD4Khw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1702816121; a=rsa-sha256; cv=none; b=YI891LNbXb5Zl9EoEJIw4AUbhqRMAIyb4umVRoEbq4zZhnLpBrvmP4ulRsRmTLFtqA0R/g Z/O9SHpIQz4Fw9rCVPtOuUe0mjjkoGwYTq1McjDUk5iFC2yOVd/nWAqqSgDoIhGGWVY9Bd famzAY+uOvHK357z8ZYARFxCmXJIx9X2WHMqr1dq1CyGUoJv5u1aAUwLBeuR1wEPLYr74w yVspiS/5N06En8/VDrolMVlp3+LGjfbUHroEIOJKEBqxW8kG/9+7ZyuCb3ShUPv0oq1iVF IW31Lw55HnVCCu7NAQ0g0LO4T1E6kLKIwhgvB4HD24irobzJPWDUZcPJo2o1zQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1702816121; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=dRnpOMxYa/jTfcJGtkOGBVbfo/3sccWYgbK4+8GdQ9Y=; b=YP7M8ivW8KKcO7Qq2F6EQs4Ei+LxUzJ8sdbbm2iAZomHUhe8mS7hEmd689EQQPTPxIdZZI /n3f0RI/nXTHnfcIHEEfz/ePn5XV5CZsWBUW6rgT9ccjErAi7uUK52o4Ut/Ot2CSGCHGdN rRil6Xd2wnw5289ArT5s5Zfz0QanaSmyQJCmCAP8H0hXgCoOpKPTPYUssMWmWXY62k+wdv e/CbyMKfu4lP0lR1KFfy+7HfOuLhNV4KM6NNYseJVCKDJlZicRn7SohUuH0gs9Goqk7+tD ozhvcOG5N/mUFQFM2Ppf546QNaWxkaC5RIWlNk7lK8+9uvMClaswYpE45g76+A== Received: from mail-qt1-f179.google.com (mail-qt1-f179.google.com [209.85.160.179]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) (Authenticated sender: eduardo) by smtp.freebsd.org (Postfix) with ESMTPSA id 4StMgs0jv2z19LH for ; Sun, 17 Dec 2023 12:28:41 +0000 (UTC) (envelope-from eduardo@freebsd.org) Received: by mail-qt1-f179.google.com with SMTP id d75a77b69052e-4260b6eaae9so25371201cf.1 for ; Sun, 17 Dec 2023 04:28:41 -0800 (PST) X-Gm-Message-State: AOJu0YwBFhqoc3LzddSPFpe7p5hNvyf63cNRjTOHs4hGkYC4dHjNplz/ 3wZDcSzOdhRtp9riGVa6TAEdZdzdpW1NVUyuVKY= X-Google-Smtp-Source: AGHT+IH6PxnEothVj4tqasI4r1qVgr8KGJemXGjAB5WQsEetjMxAXBQNuxwD21GkJDYzc3CMP75RnqUn2rw29aUUvfY= X-Received: by 2002:a05:622a:164f:b0:425:aa85:e014 with SMTP id y15-20020a05622a164f00b00425aa85e014mr20227593qtj.137.1702816120381; Sun, 17 Dec 2023 04:28:40 -0800 (PST) List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Nuno Teixeira Date: Sun, 17 Dec 2023 12:28:29 +0000 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: bhyve nvidia gtx-1650 mobile passthru on win11 To: Stephan Althaus Cc: virtualization@freebsd.org Content-Type: multipart/alternative; boundary="000000000000f92816060cb3c5fb" --000000000000f92816060cb3c5fb Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable > Do you use UEFI boot on both host and vm? Yes. Stephan Althaus escreveu no dia domingo, 17/12/2023 =C3=A0(s) 10:43: > On 12/16/23 18:49, Mario Marietto wrote: > > for sure you can use nVidia gpu on the host and the intel one on the > windows 11 vm. > > Il sab 16 dic 2023, 18:11 Nuno Teixeira ha scritto: > >> It seems that nvidia passtrhu isn't working (yet). >> >> Related to intel integrated graphics, I don't know if I can use it for >> ppt since it is in use by freebsd. >> Other thing, if I boot with BIOS on nvidia dedicated then intel doesn't >> show up in pciconf... >> >> Mario Marietto escreveu no dia s=C3=A1bado, >> 16/12/2023 =C3=A0(s) 16:34: >> >>> Are you trying to pass the nvidia gpu to windows vm ? or your intel gpu= ? >>> >>> Il sab 16 dic 2023, 17:07 Nuno Teixeira ha >>> scritto: >>> >>>> Hello all, >>>> >>>> Specs: >>>> - laptop with integrated intel + dedicated nvidia >>>> - 15-CURRENT 3b1904d9eb04 amd64 >>>> - win11 with nvme and tpm >>>> >>>> I'm sharing my results with nvidia passthru: >>>> ### >>>> /boot/loader.conf.local: >>>> vmm_load=3D"YES" >>>> pptdevs=3D"1/0/0 1/0/1" >>>> >>>> ppt0@pci0:1:0:0: class=3D0x030000 rev=3D0xa1 hdr=3D0x00 vendor= =3D0x10de >>>> device=3D0x1f99 subvendor=3D0x17aa subdevice=3D0x3fa5 >>>> vendor =3D 'NVIDIA Corporation' >>>> device =3D 'TU117M [GeForce GTX 1650 Mobile / Max-Q]' >>>> class =3D display >>>> subclass =3D VGA >>>> ppt1@pci0:1:0:1: class=3D0x040300 rev=3D0xa1 hdr=3D0x00 vendor= =3D0x10de >>>> device=3D0x10fa subvendor=3D0x17aa subdevice=3D0x3ffb >>>> vendor =3D 'NVIDIA Corporation' >>>> class =3D multimedia >>>> subclass =3D HDA >>>> >>>> bhyve: >>>> -s 6:0,passthru,1/0/0 -s 6:1,passthru,1/0/1 >>>> ### >>>> >>>> - Installed nvidia drivers without problems >>>> - graphic card is detected but is deactivated with a triangle and a "!= ": >>>> "Windows stopped this device... code 43" >>>> - hda is detected and shows no problem >>>> >>>> I've read that some nvidia cards are working... >>>> Any tips are welcome. >>>> >>>> Not sure if it is possible to use intel integrated as it is already in >>>> use by OS. >>>> >>>> Thanks, >>>> >>>> -- >>>> Nuno Teixeira >>>> FreeBSD Committer (ports) >>>> >>> >> >> -- >> Nuno Teixeira >> FreeBSD Committer (ports) >> > Hello! > > i had just the same, here on illumos. > i didn't get it to work, but i had a similar problem with an AMD card :-/ > > i think i will try it again in Jan/2024, and then with a fresh install of > windows... > > Do you use UEFI boot on both host and vm? > > Regards, > Stephan > > > --=20 Nuno Teixeira FreeBSD Committer (ports) --000000000000f92816060cb3c5fb Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
> Do you use UEFI boot on both host and vm?
<= div>Yes.

Stephan Althaus <Stephan.Althaus@duedinghausen.eu> escreveu no dia dom= ingo, 17/12/2023 =C3=A0(s) 10:43:
=20 =20 =20
On 12/16/23 18:49, Mario Marietto wrote:
=20
for sure you can use nVidia gpu on the host and the intel one on the windows 11 vm.

Il sab 16 dic 2023, 18:11 Nun= o Teixeira <eduardo@freebsd.org> ha scritto:
It seems that nvidia passtrhu isn't working (yet).

Related to intel integrated graphics, I don't know if = I can use it for ppt since it is in use by freebsd.
Other thing, if I boot with BIOS on nvidia dedicated then intel doesn't show up in pciconf...

Mario Marietto <ma= rietto2008@gmail.com> escreveu no dia s=C3=A1bado, 16/12/2023 =C3=A0(s) 16:34:
Are you trying to pass the nvidia gpu to windows vm ? or your intel gpu ?

Il sab 16 dic 2023, 17:07 Nuno Teixeira <eduardo@freebsd.org> ha scritto:
Hello all,

Specs:
- laptop with integrated intel + dedicated nvidia
- 15-CURRENT 3b1904d9eb04 amd64
- win11 with nvme and tpm

I'm sharing my results with nvidia passthru:
###
/boot/loader.conf.local:
vmm_load=3D"YES"
pptdevs=3D"1/0/0 1/0/1"

ppt0@pci0:1:0:0: =C2=A0 =C2=A0 =C2=A0 =C2=A0clas= s=3D0x030000 rev=3D0xa1 hdr=3D0x00 vendor=3D0x10de device=3D0x1f= 99 subvendor=3D0x17aa subdevice=3D0x3fa5
=C2=A0 =C2=A0 vendor =C2=A0 =C2=A0 =3D 'NVIDIA = Corporation'
=C2=A0 =C2=A0 device =C2=A0 =C2=A0 =3D 'TU117M = [GeForce GTX 1650 Mobile / Max-Q]'
=C2=A0 =C2=A0 class =C2=A0 =C2=A0 =C2=A0=3D display=
=C2=A0 =C2=A0 subclass =C2=A0 =3D VGA
ppt1@pci0:1:0:1: =C2=A0 =C2=A0 =C2=A0 =C2=A0class= =3D0x040300 rev=3D0xa1 hdr=3D0x00 vendor=3D0x10de device=3D0x10fa subvendor=3D0x17aa subdevice=3D0x3ffb
=C2=A0 =C2=A0 vendor =C2=A0 =C2=A0 =3D 'NVIDIA = Corporation'
=C2=A0 =C2=A0 class =C2=A0 =C2=A0 =C2=A0=3D multime= dia
=C2=A0 =C2=A0 subclass =C2=A0 =3D HDA

bhyve:
-s 6:0,passthru,1/0/0 -s 6:1,passthru,1/0/1
###

- Installed nvidia drivers without problems
- graphic card is detected but is deactivated with a triangle and a "!":
=C2=A0 "Windows stopped this device... code= 43"
- hda is detected and shows no problem

I've read that some nvidia cards are working...
Any tips are welcome.

Not sure if it is possible to use intel integrated as it is already in use by OS.

Thanks,

--
Nuno Teixeira
FreeBSD Committer (ports)


--
Nuno Teixeira
FreeBSD Committer (ports)

Hello!

i had just the same, here on illumos.
i didn't get it to work, but i had a similar problem with an AMD card :-/

i think i will try it again in Jan/2024, and then with a fresh install of windows...

Do you use UEFI boot on both host and vm?

Regards,
Stephan




--
Nuno Teixeira
FreeBSD Committ= er (ports)
--000000000000f92816060cb3c5fb-- From nobody Sun Dec 17 21:00:21 2023 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Stb2F5QF0z54F8h for ; Sun, 17 Dec 2023 21:00:21 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Stb2F2HRkz3YBm for ; Sun, 17 Dec 2023 21:00:21 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1702846821; a=rsa-sha256; cv=none; b=s+BSkeKV9IDeJVi6jsTl4WtmJmYJReMfVZ0wNtnt3LRmSJ7z69IlwQ+8mZjWHdcHqg0Xhv +F0nlAdrftrWPLjAUpQPZ3RoBTIhWIM00isqBKuxFq7HL1FT+6BI1NMDhMxpi9K7K8UzIW 3EdDOjRrnPt4vWxF6SMnyr6R2qB4OpZ2ixWmt6eMwTYLntXrinvwCo5iQWx9+VHikKYmW/ QWQXubI+4IJmRUbwKWSRtyOFKN3z71kw1Wp/aMGb07TYiwzk5eqNscuS0M8K4lN2BUN+iK iDXbNGOjTjffAVgL8DS+TkmYNsE0xmOhgirW5ZO/QuEgt51W6R5KsGjT+T48VA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1702846821; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=kf6laVHyd7uXYd1faNwvq/pusirfZe+xjLSONzDAErk=; b=uATmhxvV2lr8y+dUEj+2eALjd7dCmymxp3VIWhXlvhQvrn/6gpDhPcmZQiHZ9xZLyNuRiF 1mLguA/TgI/m6i8HNyXjn3gg1SzSeiZZFu8lwDdcRq/YYsrW2ChqEAnNNR5jCuwY+iWDjw 2tYO7NO9PEapaMKG0vvj6jIGmTlq6lHIsGNXqsUaEpeorbW489rg/viRJr6JGe6oMjqzY9 7pVrgjwF+3eNBXktaTeeFFv0LazxfGmGWRqC7hhqYIQC3I5IDVNRUKQ1IjC9CeRLSKsIbI CCaI0t+SJ517CTf8mT1utjYsB5n8XNk2sr6Z8uOWP1IGqz4VSIDGvUs7POs07g== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Stb2F1692zss0 for ; Sun, 17 Dec 2023 21:00:21 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 3BHL0L1W010387 for ; Sun, 17 Dec 2023 21:00:21 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 3BHL0Lro010386 for virtualization@FreeBSD.org; Sun, 17 Dec 2023 21:00:21 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202312172100.3BHL0Lro010386@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: virtualization@FreeBSD.org Subject: Problem reports for virtualization@FreeBSD.org that need special attention Date: Sun, 17 Dec 2023 21:00:21 +0000 List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="17028468210.5C3F1.8338" Content-Transfer-Encoding: 7bit --17028468210.5C3F1.8338 Date: Sun, 17 Dec 2023 21:00:21 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- In Progress | 247208 | mpt(4): VMWare virtualized LSI controller panics New | 240945 | [hyper-v] [netvsc] hn network driver incorrectly Open | 244838 | "bectl activate -t" does not honor the -t flag in Open | 264253 | hyperv: ifconfig media autoselect on FreeBSD 13.0 Open | 264267 | UEFI Booting on Azure Generation 2 VMs crashes 5 problems total for which you should take action. --17028468210.5C3F1.8338 Date: Sun, 17 Dec 2023 21:00:21 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
In Progress |    247208 | mpt(4): VMWare virtualized LSI controller panics 
New         |    240945 | [hyper-v] [netvsc] hn network driver incorrectly 
Open        |    244838 | "bectl activate -t" does not honor the -t flag in
Open        |    264253 | hyperv: ifconfig media autoselect on FreeBSD 13.0
Open        |    264267 | UEFI Booting on Azure Generation 2 VMs crashes

5 problems total for which you should take action.
--17028468210.5C3F1.8338-- From nobody Mon Dec 18 02:31:18 2023 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4StkN65gWbz54fS7 for ; Mon, 18 Dec 2023 02:31:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4StkN6473cz4K60 for ; Mon, 18 Dec 2023 02:31:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1702866678; a=rsa-sha256; cv=none; b=Y5fRlCwRCGBiuZvznLde9caBGYaeYCVpJv4Hl1XKk5S9O12Vb/uVvSZdN6CcxinLBQMfck 2Sh13lKFlv3hQ0IBNqGNn7uA/Hxb3PXnAK7DQTj2HQbYqOGtfJ2M8jhAHeQoecFZ7+Rml9 Q/X0QpquJE3xYiKVaw2HlIimjYllRwDs87yXXyz8/2JSzxij0Sh+yd69+hP5GkLtgUm/jK gjLzq9IL+tytf8BCwzvcib7+FULCniRfZLkVTRAcW/GU8qa07f32DzPeIZ9fCtYTdiSeSW lr09h1OSISmHgW4pBlQ7/xTz4IjCJ1+82xDYOwuZJDMb4bF5YbsaUAQL7FSHug== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1702866678; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=DTqlKmcarYZxj0As5K3P8XT2rGIHdVIZDx96BfuUzDM=; b=ap0Y/iS0y/Yiz2LS0tRse4H62mOdrcNwh+0EyGMjoblSXR2VIvo6Pju0r3SgLJuGGIVIzK TGoMYaUGwNCYW+gtkh7P9hb0SmkCP/NjRgPzZM3EEd0Aan9uxYTkyIgiEdKuJdjWaKv6ZU UlixJetuZGSSYBkIYOTmWX1Y4aq1qa/AAV9xmy8nsGgvSIpvLnds+6tGCQF9VtRUjevrlo gHDlRGJJvQOi+a0mDWzuyXKRVFUwLhvEF9QUa6vvpbJCVMqEbdvbEtLgCe7EMgfDlEHqTh LVn2p8RZ0PsHG3JEx+Ewps0Ryr7FslBK/zDGEQuzfaaf5aUrQH8Vil7rYGXxIA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4StkN63CXKz139W for ; Mon, 18 Dec 2023 02:31:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 3BI2VINt007346 for ; Mon, 18 Dec 2023 02:31:18 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 3BI2VIp2007345 for virtualization@FreeBSD.org; Mon, 18 Dec 2023 02:31:18 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 275760] bhyve: xhci not working on linux guests Date: Mon, 18 Dec 2023 02:31:18 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: 14.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: slava@planetslav.ca X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D275760 --- Comment #2 from Slava --- Hello, I can confirm that the same issue happens in Fedora 39 and Ubuntu 23.10 Live media bhyve guests.=20=20 I spoke to someone on IRC about this and they suggested opening a bug report for it; looks like you beat me to it. I'll be happy to help test. Thank you --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Dec 18 10:02:40 2023 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4StwP03FqLz54GBR for ; Mon, 18 Dec 2023 10:02:44 +0000 (UTC) (envelope-from corvink@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4StwP01dlLz4jKl; Mon, 18 Dec 2023 10:02:44 +0000 (UTC) (envelope-from corvink@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1702893764; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references:autocrypt:autocrypt; bh=yzNv1MgnFL2/Nt3HRhCs0O8kxkFIxYWmYsIcUQZ3kck=; b=BH6K8IyuV6KAHhwesuoYtmrZa/MeHlRkoms7ZfrS/jbShvXDMpTXznt537o+2kfscwVACV ZpFlQgi7FdcVAdLwzoH1FRH4EKd0+Zf9v1CBPeLgaC8AgPssbEGaNYyqkeo+x3M76bO/yW Tm/HFEJ36oFZhWUkEdO+6OpuaZfZB7tZKpgZS/sBFpIKvsfYB16/QJfgn1HQ78Jvdqx2M4 6xH6vBzyUVvbWemLm0tcQsIeHfaNI2lKGEvcR8uXRxviwnABL0yId86UYhgTU9gTI7ObgH 6M33/7c28KALNkSJYZRwfDT9DMUz4QC142OaqjbFmz58jnw4Ya+BdFSvizkvCg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1702893764; a=rsa-sha256; cv=none; b=BXUQg/F37+vhOxx7XzdN1OJ9s9teEkP9hOnBXdtlk4xHXBPwyLzg0ndXNTmxinujoMPvGL LXQQXVQCPcesZx5kcm4viXaGn01eSbP/6olEhuGdxZv1wdzWhaKNBr0aSBgOBgZUmLr/vj 8cXaarr5jYSVGkXHUF8/QScNRM5HXuFM1V1qq89qW6Bz8fGG0N6ZeWvCkA4MOg4XfK+26R 3KeLybWK8V2v8370p2hYkFsy2uDs4CRDj4FITTR7rwIr6Orrxq/95vVMJusEoLWclWg9oR obMXTb+RhubZ/XyFpAcz5vdkLz1IQlY5iaQh7cCCvuqBzEhzkT2/JalaV+AmDg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1702893764; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references:autocrypt:autocrypt; bh=yzNv1MgnFL2/Nt3HRhCs0O8kxkFIxYWmYsIcUQZ3kck=; b=S8NbCj7GsPZkcjziB4EYYdw5ySO1NFkAOWKqYU1gmoCNr3BHc4H0IwBnswqGu0mlWM2cE+ 6Hz+iNxfXaqofyYFoQKA2GCbgTksXZGxWrZco8ntfsXttSH3fDbS6Gxi7RZNtk0GDALQfd RmUyher8MtRMmU/dtMSvUmyUefyyNLgbMuGcLbtVkUctErJE7ZQkQDK+E+DFTwPxV+LLFP wxGPwM/A8PYnLVr3OpXbhJIXbqmwU7bq/1UMOjwGl4vXhv6juCUEM0AJHzU7ouXwayN76c sLNKjNZDE+Xml/AneRKB87BSjh9kOcG0p5f0WGOVa2+M1gKJe68/D7hk61XXCA== Received: from [172.21.179.165] (unknown [195.226.174.194]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: corvink) by smtp.freebsd.org (Postfix) with ESMTPSA id 4StwNz50gkz868; Mon, 18 Dec 2023 10:02:43 +0000 (UTC) (envelope-from corvink@FreeBSD.org) Message-ID: <101df7552fd1673ddc73e14daf518630402129c4.camel@FreeBSD.org> Subject: Re: bhyve nvidia gtx-1650 mobile passthru on win11 From: Corvin =?ISO-8859-1?Q?K=F6hne?= To: Nuno Teixeira Cc: FreeBSD virtualization Date: Mon, 18 Dec 2023 11:02:40 +0100 In-Reply-To: References: Autocrypt: addr=corvink@FreeBSD.org; prefer-encrypt=mutual; keydata=mQINBGNjZaIBEADDTrDNf+0pwiuRPBdClcnZW83dH1UhuOi0u+A1J2SatEBbNaFVtXXAavewCTuyV/ZbNidjlhq3R/pWyiKjFKvs5dj7PMCw+3z2D5OWpMdHg7TrB+fbdFPOEsu0zQVKNaO+pSKCfN0Re0m7bL3wuvl7PXvBufRwA3Guo1P4j3TXWaEkuso7VupTvE25zVGg9ONHrGOjA9RUy+Yg4Se3NLgtUdjBgA21SBQTDvRQV4fDmVenlwvWeE0Xm8FcDcpQb6sJTihaDku78mi3Ux1HCk7rTcepVEB0xIB6qmFxv0sLlDmVv6Z6qg1y/Q5m23Pgz60o3TulMPV4F+3Itm8ifU+wgVSzBZbD29GYkd7LKqMkFbhvfSBk+5db3vbYY5OD//+LTM5AV7e2AhXuXMvG1UNBqXqSJTTSy6KZz+qmPQO0zos0dq46p8o82lKiBEGD2Hu0p+u0OyV+MmRYo1NIBFVbOPXp2MvUVl5II0UIJ3+N9gLBmfGA+HEpVO8PnvdoT/5NQ7m8JK1rQHzjiDub/iDPAYMqKH4C0eZ/7zO0fuY5FeRNtuNtpH1Bw/+7/5RJH7bcKkfGHHEp15FJUrGHgWNydoDLB9QBprwQc8FEldDXBjzOMXIgh6FGKLNu6DswvIPGy6M3u7DXwDakCXz+c9Ym0oFihLzZxWntrsxdswD/CwARAQABtCdDb3J2aW4gS8O2aG5lIDxjb3J2aW4ua29laG5lQGdtYWlsLmNvbT6JAlQEEwEIAD4WIQSC9FKVreba38fZT0bYVNpWMV4CagUCZArUIwIbAwUJCWYBgAULCQgHAgYVCgkICwIEFgIDAQIeAQIXgAAKCRDYVNpWMV4CalcID/44k2i/mqSSi4W6FAobSF1nFLtP/pfcRNJriWKx2UF7cfFMKyg7Nilg7FhLb5FDB1umUW2nFfchFPTUp4FfKzgRvPzIMg4RIRcVtTpYbl3z7zs9ZXD8q S//iibbiUG3quncm6tO2x1jLZD3ORC+8MuLGXhYQIa4O5vVF2SBHdb/U6P+wsrF+U+OpRdEdQ/4Xu9S02kltzBGgArjcexdhUqEqW01KCCSH0+qgfN1NE+9L934ZOB+cai2b9apPbCOGuV6KcUKMj4z0RWInhlXIyMqtmhdix/P/GjrQ1REVNdp74JeweSSedM15wwc6YLMXPrtOnnExyZ1gyNFYaub+Mdo3ZQ+83863B0C9IlpzEW0K8bYlZrl4WBNdcMOyByETAxgQmBgP6ZFErTtaeUOH1nX2FyR6o2GLSahRgngQmnREzScTpPbBEkMwJMDAO+rbjjGxjeKSUwD1WOfbI6QZj+MS/uBk2p08kgN7fQaCEwj6jqML/IIE+FZ9IIn6TNG0hChD384VHO+YioLBno1Atgi4Q7JUWSRIHQXZW+StQajFrWPPyKQwCe1MwqpKoMpX/q8IZBlzwJgZS8ShLeFZjtzOt1jgM99TD91Neonf9OzjTSbfo7sJviSWoICMhB/MvDZjj+naMVF86uGFxnIEsjVKyBxlJd4TRHnLYPTIHFKBLQjQ29ydmluIEvDtmhuZSA8Y29ydmlua0BGcmVlQlNELm9yZz6JAlQEEwEKAD4WIQSC9FKVreba38fZT0bYVNpWMV4CagUCY2NlogIbAwUJCWYBgAULCQgHAwUVCgkICwUWAwIBAAIeAQIXgAAKCRDYVNpWMV4CavfDEACCFnXpR7H9eOgP+GJMNPtK6i9/xnqdyXi8uCZIN0hYwjN4Xzo9SMLOf4UUlQEveOB+bGqbRfHd/fGKnrlXiPd0SGpKWJC21gqL/DsIH0J8I3Whth+O8tfPWeFy0oCsvBaaGFLIrDfoIgHF9i/gqEe48xhN42weB02Z3mdR1L0d7ME/BLwS0mCXe9Zh3uHw63S6xYB3Wsjptxe/ph6TpQDUKWtRJkjC6BqXPBdThpbbfIRWmjZbp2fKEJPvtRXS14+gbUqWeJ 4xCvprA3+ae7vtrp91X775yngyW3XTw5cmDiJIjykH8+zhEIoNQXNBpFrehkQDYrcM+WoE6NGSJo+3VJvSRWhUGWDVrxdTYNkbIjmTNlkI12NINC007DiuV7OF9XHWgrbbylvuZvbODmbJRdhTFy9upAUygX1/xUAQEIMqMiJmyTdv8i0IbZ611WElQx9XHgGeZgM6+39/laN8FwspM6gE/4NzZHIZN0LEBOerZqoF+Il6eccQpoEWx7nb/RilJp3dUUyvkBnJWg+AJByosg857kvvmDnZ3UB+bejWpcfFvnbkiKPUBPDO7tWPb5r2yFDpDe/Vg5x+sRbkkXGUFD6Rx0p/ZiRIneVVg8emTzhDR0IL/BZkq/uVJkdaphZli1F/31cNgf6ZJYnjxlk86uiYSySZQR0dKLDqq7QlQ29ydmluIEvDtmhuZSA8Yy5rb2VobmVAYmVja2hvZmYuY29tPokCVAQTAQgAPhYhBIL0UpWt5trfx9lPRthU2lYxXgJqBQJkCtScAhsDBQkJZgGABQsJCAcCBhUKCQgLAgQWAgMBAh4BAheAAAoJENhU2lYxXgJqI+QQAML5PTR7KpUFV3SLG60LQJGEOHUfDmJYczxBFbIAq1U4hIbivopu1AdLty7oDDrIjCVoa2/Cy34dd99O7lhLvUmZFB/zDSUtbUg2zhDkU0YSZ11FdrlWzky2tFaQRgxpDvWlUP0baa3Pd4dPDRiIUI6AOSR2SL6XANk6sJh56gLVM6G8yyafGsxSyDYg6Z78EEMFejHwB+KP2DdsahupzM+F97HeC1+bOHYxtqN+2hEkPLtQWizyumPqNg5FvZhwe7yO8V95hF3RhuDO+9aJT+WLLvcZEb/L1bI04IvZ5FWgCLI7Levd/DuOtZI8gWapHhqGZRbXB2fuJkCoKCl6V67h/7aWhU3LjFTsC5siJyrxPjapKcIk8a7PqZDswNCKR+24LJ5D59mPgEOnsiCCVpik1WE /kgD+rOu9dQxjpjKwuKowf4EJP1KYNkYtoy1HthzyTOqPwqXC3IUl0GVPO3xw6MhUM3irCVFruC+ecVrv85Rd37vrduT6JvgW92xjWegMsamtkDZH8Ik/cmYhH0K/qEc6OZVNea/4PTEZe0uxODJ6pbMd80AJyGqDPPVeAgWJtEIG4k6IS8XyD5v1QJtlpDVpPwP/bbFnVc3h3Oatfn8Etm1KAqYvNwyO+om2PkF1p732uapDZdLwksVmgc9s79+9pSpeP5DbIeMzhrIKuQINBGNjZaIBEAC4V8zlnLa957NAFPmOuW6cL1W1/E3pMtoxNYMaZmOtEDaOLV645qfie2XXh2Bn44hzN3vZ3ZaWV9FKipGTxCTNL6Im6o8ghKX4cIBiACeSbcAcIdsxCGnFLO46lPm7NYbGGfU532A8QfvpYeO4ue8H+qNWw9lWXCU1djoPwbo9McfyJ7CA3reT9wgPO4/nAo1StfeiYvkOWoxYwpiNstzUZMmd6dRCJhDtHyy639VB2YsvhyLYVB9yQdv5M2VPk2q+oodiTK/uZvaoubsIqkVlL/fqBdx+bZOG6eSogqTjTLFN5S6EjL4usCY1Vv19uDhWwuvADuMChu3jPNm4PC8pI6O4DPiWAqt+Aw4WDfKM2ie8JqzCtUXf/Iv+aSiMhNMT0qGn+Ybq98yWXs1k67M7PheurWO2hfYtMQJtpHYHqz3T7VC0F4bAPl3rDRL4PJ2Vr9eoo5upVPbZN1JXAA5oEX7coA1BQz/18LlTBhNmHk2wsi5omYZOnBoZelA7kpNx/8zc2zanOnO7NW0dJLq/o4GlfP56UFV8I1MWNyI351BAkIJyThrjv7aMxLhpNny6uYoms7X2oWf2R//QIMA/0jkqsGirksV4CW+7xhuQVwxGIHR2JskZYaPSjJaXTvoGxu/+SwqT00xnF64ZvwDUGiw7yB70s/LolEOZ/5JqgQARAQABiQI8BBgBCgAmFiEEgvRS la3m2t/H2U9G2FTaVjFeAmoFAmNjZaICGwwFCQlmAYAACgkQ2FTaVjFeAmrhSw/+NqYqv6oHppWZ7hpt+2Df+qIw2kOgvo0ecU8orastt7OfiJpRzlDFPK2nhok5t4+1PZCi4jcR5Ub22Ddy4O00FOCRAq70haA+cNNiZ0XlD5cDv+CxmT0NkD337ls5wz8zyOX7n7Z4jG8ghiJEkcLQbyp2qYaggKrz2sGWKUjByS7jySRCotPOO+0W6Iz2dw9215ZQ1F3uZwdRlpXA7ypzUBEvIJxc563fFuPetbZAIavGMT844hovsMXW2Q/MS3HI03USkgeVaqANbSOUFAdt2tgTrvUw/vXBckp4T+vATNdQH0WieBIX4nRQQ6SjfmaI82QxJuJjb5NJ6bgS+HPIUH8J1Iw958y/Rs5svzKW+/YYoZBDuhtbAeoJdiy7a7wtK6pBv+xMdpmKLBgVVXOeX6sucwJ/K68tb5aOmbuPLAaIoKgm/9IF8dqiI23JoM2ZhpYZjpVMpakGIxV6R4Kp2hrqC4oNpuVLJ7LQSMuocXduguvWYdYvVXSdpC1Ed+fLtFXA0h5fhDqHFDCDM2CgQX2DfzXe/rV7vChm61fQYn+85md1vPiefnsaunEh3+cbcFfIshNmIRfAKwA2//75eqgBuC2D5ZIr93LsEUCcabnQZdaZKGSo/ruWNZdPyjj/b6MhAifkoFFrkN4/dwIqYIev8wMbh3+7dcZIRza0foM= Content-Type: multipart/signed; micalg="pgp-sha256"; protocol="application/pgp-signature"; boundary="=-6KzN/P86HvMPwDJir/gB" User-Agent: Evolution 3.50.2 List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 --=-6KzN/P86HvMPwDJir/gB Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Sat, 2023-12-16 at 16:07 +0000, Nuno Teixeira wrote: > Hello all, >=20 > Specs: > - laptop with integrated intel + dedicated nvidia > - 15-CURRENT 3b1904d9eb04 amd64 > - win11 with nvme and tpm >=20 > I'm sharing my results with nvidia passthru: > ### > /boot/loader.conf.local: > vmm_load=3D"YES" > pptdevs=3D"1/0/0 1/0/1" >=20 > ppt0@pci0:1:0:0: =C2=A0 =C2=A0 =C2=A0 =C2=A0class=3D0x030000 rev=3D0xa1 h= dr=3D0x00 > vendor=3D0x10de device=3D0x1f99 subvendor=3D0x17aa subdevice=3D0x3fa5 > =C2=A0 =C2=A0 vendor =C2=A0 =C2=A0 =3D 'NVIDIA Corporation' > =C2=A0 =C2=A0 device =C2=A0 =C2=A0 =3D 'TU117M [GeForce GTX 1650 Mobile /= Max-Q]' > =C2=A0 =C2=A0 class =C2=A0 =C2=A0 =C2=A0=3D display > =C2=A0 =C2=A0 subclass =C2=A0 =3D VGA > ppt1@pci0:1:0:1: =C2=A0 =C2=A0 =C2=A0 =C2=A0class=3D0x040300 rev=3D0xa1 h= dr=3D0x00 > vendor=3D0x10de device=3D0x10fa subvendor=3D0x17aa subdevice=3D0x3ffb > =C2=A0 =C2=A0 vendor =C2=A0 =C2=A0 =3D 'NVIDIA Corporation' > =C2=A0 =C2=A0 class =C2=A0 =C2=A0 =C2=A0=3D multimedia > =C2=A0 =C2=A0 subclass =C2=A0 =3D HDA >=20 > bhyve: > -s 6:0,passthru,1/0/0 -s 6:1,passthru,1/0/1 > ### >=20 > - Installed nvidia drivers without problems > - graphic card is detected but is deactivated with a triangle and a > "!": > =C2=A0 "Windows stopped this device... code 43" > - hda is detected and shows no problem >=20 > I've read that some nvidia cards are working... > Any tips are welcome. >=20 > Not sure if it is possible to use intel integrated as it is already > in use by OS. >=20 > Thanks, >=20 > --=20 > Nuno Teixeira > FreeBSD Committer (ports) Hi, nvidia: At the moment, nvidia gpu passthrough is not supported by upstream. I have a small patch stack for nvidia [1] but it's not well tested and I don't know for which guests and cards it works. amd: Should work properly on 13.2, 14.0 and onward. Note that there's a hardware bug on many cards [2]. intel: Requires a patched EDKII firmware [3]. Unfortunately, it's not merged yet. Btw. even if you only have an Intel card available you can use it for GPU passthrough. [1] https://github.com/Beckhoff/freebsd-src/commits/phab/corvink/14.0/nvidia-wi= p/ [2] https://www.nicksherlock.com/2020/11/working-around-the-amd-gpu- reset-bug-on-proxmox/ [3] https://reviews.freebsd.org/D41710 --=20 Kind regards, Corvin --=-6KzN/P86HvMPwDJir/gB Content-Type: application/pgp-signature; name="signature.asc" Content-Description: This is a digitally signed message part -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEEgvRSla3m2t/H2U9G2FTaVjFeAmoFAmWAGMAACgkQ2FTaVjFe AmqinA/9Gh/l/zlLKK0Tb2Udn1VgRAiJdFm4m3z5rbFAkEKB5x++6WnZSNgQaPDk SA1K/4WTQPsjrMlDZPLERiyxIvjEqR2zXe1k/QDyFstf6yXg2vFQEbpRlSBdvCnW 8hRG1vGTNAGuTrfmmLYcSPn/SJGWTCaz3+GtR5vmypgWEBniUkJojDItm1JNOyvF RM2NVUsVUr8VBeTALFt26ZOs6sm7bkFCIfPC2JEqYnfsuR27GlSrL5E7bRIaZEzA PB7m83IHfogRM4KJlDQiY2rpi7qvIyii328IN3l35mNkNrm053t+D6nI1IuLgj1E e4rojeApYj19AnhWpD29H4llVgLRcwq3bA3DvGGJj2R1vNX2EPplMdUecie9KRQ9 g41ueHWJ1V2TJESzbfWS2komujIguRb0NVSkstoCo4rVlNX+D71j037ZQ+S1pmFM CSaz9fXQHDdag6N+HxT3V5PUpe5nDXs/h+nOzSC5sGjgcaufLNEy1iClpxIYFoX+ YqRkD+7L4bVtn9MicAWs9y6tnqvakr7WaA5+Ix6JFTqOkpeVH7LnyrGc7S2S+V9+ GBTH8Eo3JlKSl4hPQaqF5/SJlv+8QaE3PMKuoLf1bBKIQBOjin9lP2EuSGDTwmZt RYs+hiXXgMvpImjQS0KMPrZxQFq4JBQTULphBGJKFMSbn5ztozk= =o8lt -----END PGP SIGNATURE----- --=-6KzN/P86HvMPwDJir/gB-- From nobody Mon Dec 18 10:14:29 2023 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4StwgN6QQwz54Gwr for ; Mon, 18 Dec 2023 10:15:12 +0000 (UTC) (envelope-from marietto2008@gmail.com) Received: from mail-lf1-x130.google.com (mail-lf1-x130.google.com [IPv6:2a00:1450:4864:20::130]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4StwgN3SMnz3Hg0; Mon, 18 Dec 2023 10:15:12 +0000 (UTC) (envelope-from marietto2008@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-lf1-x130.google.com with SMTP id 2adb3069b0e04-50e23c620e8so2302777e87.1; Mon, 18 Dec 2023 02:15:12 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1702894510; x=1703499310; darn=freebsd.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=QgaVJozH3sN6h75bgoiAXsY4rkctpe7tIEZgSTnUcoM=; b=E6kIo+v1WfYvo4zSjn9CvA1nHIQ2/x7AkfE4ZdguOSYImyZC/ph4jOCy+8zbLZbuSS lf3kUjtWEz9FXtCR/Lq93ZvXkrsK2grXdXUZS/IamNmpZUtSf4qULEVwFo4qJjyH/wF5 20wgI4PADYUDyfV02n5td+Hp4Om9azK9RfecYQt+R3Usy4iqTxRH3sNY24sz3mpcpH+i RVS1aW2TZVB5x0HqFndT+03H3caNwDamOqMdXw3lJQbf2VCBsISyhfxzDfvRWMlNJ3OR QMwZxl6gHjeJbk2MFle324mzaTPIfPcsG/xtLEVgLBsgbc7cdO7iPO5QUKPGNSSnVUBm 3sqg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1702894510; x=1703499310; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=QgaVJozH3sN6h75bgoiAXsY4rkctpe7tIEZgSTnUcoM=; b=EFrESwgKNfeIKutAL9eQo7gtDVqNFMF0AG35yXO0ss9FNhVddV38UhOfX7kkJeWD74 MF+hh5F6Qp61fMHXUOlki2YgZS1N0AuKyYPdtzJg+btY9ddGYoETLOEckT8v/V8OCOeY 8XssIKFW7xhZvVP/9ECDzRY+jOiWZygIG19fjW2AFzfRAdwCaTkjzfwiVr3uhEKGpCZL MJ2ugkhQIgnyaPN/k80Qiv0aZ56nL3zchmCTaQhX/kvOo2nQT+wi4oCmydutJjA/edma BWT41LJUGr3GrcVi40HvUQeVsFhjIA01G5rYJ7aCbYYQI1DMPUGNvTPmymn61DIF5TJb FZHA== X-Gm-Message-State: AOJu0YzEfJeV5BcfioeHPrHp5yM3gr+mCT0EBLJDSywWQc7YcNAvHnsL hMoj6ReH5phKx7TKPubrle9tNVAq3ItHgCZtwxKp7U7Qcxc= X-Google-Smtp-Source: AGHT+IFCQBVEGktKelfea7W4YFz4YarMag/5kVwNtZeMYNmnQmzaFRcwXRFwHUyRefIjCiKEgN2nJvLqTmm7dUW3EVY= X-Received: by 2002:a05:6512:b9c:b0:50c:180:2162 with SMTP id b28-20020a0565120b9c00b0050c01802162mr8550923lfv.99.1702894505439; Mon, 18 Dec 2023 02:15:05 -0800 (PST) List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 References: <101df7552fd1673ddc73e14daf518630402129c4.camel@FreeBSD.org> In-Reply-To: <101df7552fd1673ddc73e14daf518630402129c4.camel@FreeBSD.org> From: Mario Marietto Date: Mon, 18 Dec 2023 11:14:29 +0100 Message-ID: Subject: Re: bhyve nvidia gtx-1650 mobile passthru on win11 To: =?UTF-8?Q?Corvin_K=C3=B6hne?= Cc: Nuno Teixeira , FreeBSD virtualization Content-Type: multipart/alternative; boundary="000000000000163ec4060cc60625" X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] X-Spamd-Bar: ---- X-Rspamd-Queue-Id: 4StwgN3SMnz3Hg0 --000000000000163ec4060cc60625 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hello Corvin, about point 1) : Nuno is trying to enable the passthru of his nvidia-gpu on Windows 11. Is your patch intended to work for Windows ? If yes,I would be ready to test it on my system. On Mon, Dec 18, 2023 at 11:02=E2=80=AFAM Corvin K=C3=B6hne wrote: > On Sat, 2023-12-16 at 16:07 +0000, Nuno Teixeira wrote: > > Hello all, > > > > Specs: > > - laptop with integrated intel + dedicated nvidia > > - 15-CURRENT 3b1904d9eb04 amd64 > > - win11 with nvme and tpm > > > > I'm sharing my results with nvidia passthru: > > ### > > /boot/loader.conf.local: > > vmm_load=3D"YES" > > pptdevs=3D"1/0/0 1/0/1" > > > > ppt0@pci0:1:0:0: class=3D0x030000 rev=3D0xa1 hdr=3D0x00 > > vendor=3D0x10de device=3D0x1f99 subvendor=3D0x17aa subdevice=3D0x3fa5 > > vendor =3D 'NVIDIA Corporation' > > device =3D 'TU117M [GeForce GTX 1650 Mobile / Max-Q]' > > class =3D display > > subclass =3D VGA > > ppt1@pci0:1:0:1: class=3D0x040300 rev=3D0xa1 hdr=3D0x00 > > vendor=3D0x10de device=3D0x10fa subvendor=3D0x17aa subdevice=3D0x3ffb > > vendor =3D 'NVIDIA Corporation' > > class =3D multimedia > > subclass =3D HDA > > > > bhyve: > > -s 6:0,passthru,1/0/0 -s 6:1,passthru,1/0/1 > > ### > > > > - Installed nvidia drivers without problems > > - graphic card is detected but is deactivated with a triangle and a > > "!": > > "Windows stopped this device... code 43" > > - hda is detected and shows no problem > > > > I've read that some nvidia cards are working... > > Any tips are welcome. > > > > Not sure if it is possible to use intel integrated as it is already > > in use by OS. > > > > Thanks, > > > > -- > > Nuno Teixeira > > FreeBSD Committer (ports) > > Hi, > > nvidia: > At the moment, nvidia gpu passthrough is not supported by upstream. I > have a small patch stack for nvidia [1] but it's not well tested and I > don't know for which guests and cards it works. > > amd: > Should work properly on 13.2, 14.0 and onward. Note that there's a > hardware bug on many cards [2]. > > intel: > Requires a patched EDKII firmware [3]. Unfortunately, it's not merged > yet. Btw. even if you only have an Intel card available you can use it > for GPU passthrough. > > [1] > > https://github.com/Beckhoff/freebsd-src/commits/phab/corvink/14.0/nvidia-= wip/ > [2] https://www.nicksherlock.com/2020/11/working-around-the-amd-gpu- > reset-bug-on-proxmox/ > > [3] https://reviews.freebsd.org/D41710 > > > -- > Kind regards, > Corvin > --=20 Mario. --000000000000163ec4060cc60625 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hello Corvin,

about point 1)= : Nuno is trying to enable the passthru of his nvidia-gpu on Windows 11. I= s your patch intended to work for Windows ? If yes,I would be ready to test= it on my system.

On Mon, Dec 18, 2023 at 11:02=E2=80=AFAM Corv= in K=C3=B6hne <corvink@freebsd.or= g> wrote:
On Sat, 2023-12-16 at 16:07 +0000, Nuno Teixeira wrote:
> Hello all,
>
> Specs:
> - laptop with integrated intel + dedicated nvidia
> - 15-CURRENT 3b1904d9eb04 amd64
> - win11 with nvme and tpm
>
> I'm sharing my results with nvidia passthru:
> ###
> /boot/loader.conf.local:
> vmm_load=3D"YES"
> pptdevs=3D"1/0/0 1/0/1"
>
> ppt0@pci0:1:0:0: =C2=A0 =C2=A0 =C2=A0 =C2=A0class=3D0x030000 rev=3D0xa= 1 hdr=3D0x00
> vendor=3D0x10de device=3D0x1f99 subvendor=3D0x17aa subdevice=3D0x3fa5<= br> > =C2=A0 =C2=A0 vendor =C2=A0 =C2=A0 =3D 'NVIDIA Corporation' > =C2=A0 =C2=A0 device =C2=A0 =C2=A0 =3D 'TU117M [GeForce GTX 1650 M= obile / Max-Q]'
> =C2=A0 =C2=A0 class =C2=A0 =C2=A0 =C2=A0=3D display
> =C2=A0 =C2=A0 subclass =C2=A0 =3D VGA
> ppt1@pci0:1:0:1: =C2=A0 =C2=A0 =C2=A0 =C2=A0class=3D0x040300 rev=3D0xa= 1 hdr=3D0x00
> vendor=3D0x10de device=3D0x10fa subvendor=3D0x17aa subdevice=3D0x3ffb<= br> > =C2=A0 =C2=A0 vendor =C2=A0 =C2=A0 =3D 'NVIDIA Corporation' > =C2=A0 =C2=A0 class =C2=A0 =C2=A0 =C2=A0=3D multimedia
> =C2=A0 =C2=A0 subclass =C2=A0 =3D HDA
>
> bhyve:
> -s 6:0,passthru,1/0/0 -s 6:1,passthru,1/0/1
> ###
>
> - Installed nvidia drivers without problems
> - graphic card is detected but is deactivated with a triangle and a > "!":
> =C2=A0 "Windows stopped this device... code 43"
> - hda is detected and shows no problem
>
> I've read that some nvidia cards are working...
> Any tips are welcome.
>
> Not sure if it is possible to use intel integrated as it is already > in use by OS.
>
> Thanks,
>
> --
> Nuno Teixeira
> FreeBSD Committer (ports)

Hi,

nvidia:
At the moment, nvidia gpu passthrough is not supported by upstream. I
have a small patch stack for nvidia [1] but it's not well tested and I<= br> don't know for which guests and cards it works.

amd:
Should work properly on 13.2, 14.0 and onward. Note that there's a
hardware bug on many cards [2].

intel:
Requires a patched EDKII firmware [3]. Unfortunately, it's not merged yet. Btw. even if you only have an Intel card available you can use it
for GPU passthrough.

[1]
https://github.com/Beck= hoff/freebsd-src/commits/phab/corvink/14.0/nvidia-wip/
[2] https://www= .nicksherlock.com/2020/11/working-around-the-amd-gpu-
reset-bug-on-proxmox/
[3] https://reviews.freebsd.org/D41710


--
Kind regards,
Corvin


--
Mario.
--000000000000163ec4060cc60625-- From nobody Tue Dec 19 07:43:11 2023 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4SvTFD0K1kz54qT1 for ; Tue, 19 Dec 2023 07:42:56 +0000 (UTC) (envelope-from Stephan.Althaus@Duedinghausen.eu) Received: from mo4-p05-ob.smtp.rzone.de (mo4-p05-ob.smtp.rzone.de [85.215.255.130]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "*.smtp.rzone.de", Issuer "Telekom Security ServerID OV Class 2 CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4SvTFB59XVz3K24 for ; Tue, 19 Dec 2023 07:42:53 +0000 (UTC) (envelope-from Stephan.Althaus@Duedinghausen.eu) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=hoewweken.de header.s=strato-dkim-0002 header.b="mQJ/sFQm"; dkim=pass header.d=hoewweken.de header.s=strato-dkim-0003 header.b=olCPo+3R; spf=none (mx1.freebsd.org: domain of Stephan.Althaus@Duedinghausen.eu has no SPF policy when checking 85.215.255.130) smtp.mailfrom=Stephan.Althaus@Duedinghausen.eu; arc=pass ("strato.com:s=strato-dkim-0002:i=1"); dmarc=none ARC-Seal: i=1; a=rsa-sha256; t=1702971771; cv=none; d=strato.com; s=strato-dkim-0002; b=MhqOlJid+rHY0FvB4mtVRzTD/U+vHtwv5alkgyG/hJLPJWB0PeLqA4xz7o3/esqrKx zqgKw0fvMj3z4iNpsxFtJqNCO+P1QjS2ALDtbgRLP7CGVaWMNM4ySYOfqJROyFnrzEQk CDOv2JgsIdRdkTbAaLofGOLZyeORrg2797D++2ahka+tacHnogCBtYfPm4U447ZPzPNh fiK2d4PpLgzlo5jkWPcLRRHBFiVSxo8xbDKj+HWXUBA7Y3BHDxSndMnube+LfBF3N+jp lx6TMsSu7TVGXtMxSiBMaEYSmjOiNhDg+zmsw5CAelp3KDviasgmd3K7dvXE5JoeI8cW Czaw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; t=1702971771; s=strato-dkim-0002; d=strato.com; h=In-Reply-To:From:References:To:Subject:Date:Message-ID:Cc:Date:From: Subject:Sender; bh=1bjDsvg+tXtGfiIMNq7Pyw/Y9ZW8oGSJKVf1btNeRzs=; b=mwmbB3nKQR3PImun/3vyb7LIeLLTf0MtS8LSAsBsk6kbcopT4mORmyPSHKqWZOg3SD Gt4jhft0Nxz5OV8Uet1iq6IjC8tgQE2FwbXv6TJH9Z/+7ZluCojqQG0IOVjcZTUPP60g J2TXI1uGvo5+gDg7BFNi+RJf/b0PPUigWhojl8Qi2abqwK7aJGvastdmvZ+A8sm0x2at TUpe+jf4EvU3NeH4BEwC3INuIND03g7w162wIP9ZBWagM9v34hBsh1li8t/sWtfRD5H2 iUvZuAvUt+s1LljsaTCNINJkXRDzA77rVSK74zbTxdwF3xrutP0cV8qHPgZ28hNSA0S2 elBg== ARC-Authentication-Results: i=1; strato.com; arc=none; dkim=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; t=1702971771; s=strato-dkim-0002; d=hoewweken.de; h=In-Reply-To:From:References:To:Subject:Date:Message-ID:Cc:Date:From: Subject:Sender; bh=1bjDsvg+tXtGfiIMNq7Pyw/Y9ZW8oGSJKVf1btNeRzs=; b=mQJ/sFQmOalaOqsSZmQ9e0v0cY3GfTV8FNAl0RewSpfMK90LKZDsXoUx3Q4sWDC4Sl GpdUdaNb5ucmIOT7JdpMsXKCm0ugeuqNvX9pWpfZVRdnZFOUjFlIA0d56kaq2iVLLu1/ /ENc2t2BMJqu1ujVo73yiJbWL+LERvq30EonKlqg0050Mu5d62d4jZd1LuADm5huRv/W l6WjIw9DhOIhFM4xsJvwTLztDKUZjL3y0Kh0lV5sNokVzUNstu/u5iA0Eez68/aU4PDF STKyOfVYpXbjVyaoLGEgdJ3DMBBHibv5nJN3i3lpxZcP6SG0APBH5dkGOkcgpLiV4G6U gpGg== DKIM-Signature: v=1; a=ed25519-sha256; c=relaxed/relaxed; t=1702971771; s=strato-dkim-0003; d=hoewweken.de; h=In-Reply-To:From:References:To:Subject:Date:Message-ID:Cc:Date:From: Subject:Sender; bh=1bjDsvg+tXtGfiIMNq7Pyw/Y9ZW8oGSJKVf1btNeRzs=; b=olCPo+3RIkG2QVxRBiOhUp8k44VRWfwAO2SxbcuXZTGfu1A57qZrS3T4I8XoWO9w+8 jlllDvtI10z9AkBj/TAw== X-RZG-AUTH: ":O2kGeEG7b/pS1EW2TmikjLDsYYueHLp2aWg0q38nsxN1mOntnRORP93PLpfReKNjbyYtOAegfjheaQ4=" X-RZG-CLASS-ID: mo05 Received: from www.duedinghausen.eu by smtp.strato.de (RZmta 49.10.0 DYNA|AUTH) with ESMTPSA id 9f0670zBJ7gpIbb (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256 bits)) (Client did not present a certificate) for ; Tue, 19 Dec 2023 08:42:51 +0100 (CET) Received: from [192.168.2.63] (speedport.ip [192.168.1.1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (secp384r1) server-digest SHA384) (No client certificate requested) (Authenticated sender: steven) by www.duedinghausen.eu (Postfix) with ESMTPSA id AA028129077 for ; Tue, 19 Dec 2023 08:42:23 +0100 (CET) Content-Type: multipart/alternative; boundary="------------9I0RBcySf4ErYgQA5o70nvKf" Message-ID: <4c4dc909-9da6-41e0-99d1-72337a51484b@Duedinghausen.eu> Date: Tue, 19 Dec 2023 08:43:11 +0100 List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: bhyve nvidia gtx-1650 mobile passthru on win11 To: virtualization@freebsd.org References: Content-Language: en-US From: Stephan Althaus In-Reply-To: Content-Transfer-Encoding: 8bit X-Spamd-Result: default: False [-4.29 / 15.00]; ARC_ALLOW(-1.00)[strato.com:s=strato-dkim-0002:i=1]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; R_DKIM_ALLOW(-0.20)[hoewweken.de:s=strato-dkim-0002,hoewweken.de:s=strato-dkim-0003]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; XM_UA_NO_VERSION(0.01)[]; R_SPF_NA(0.00)[no SPF record]; MLMMJ_DEST(0.00)[virtualization@freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; ASN(0.00)[asn:6724, ipnet:85.215.255.0/24, country:DE]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_COUNT_TWO(0.00)[2]; DKIM_TRACE(0.00)[hoewweken.de:+]; DMARC_NA(0.00)[duedinghausen.eu]; RCPT_COUNT_ONE(0.00)[1]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; RCVD_TLS_ALL(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[virtualization@freebsd.org]; RCVD_VIA_SMTP_AUTH(0.00)[] X-Rspamd-Queue-Id: 4SvTFB59XVz3K24 X-Spamd-Bar: ---- This is a multi-part message in MIME format. --------------9I0RBcySf4ErYgQA5o70nvKf Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit On 12/17/23 11:51, Mario Marietto wrote: > AMD gpu works great with bhyve and they are recognized by a Windows vm. > > On Sun, Dec 17, 2023 at 11:43 AM Stephan Althaus > wrote: > > On 12/16/23 18:49, Mario Marietto wrote: >> for sure you can use nVidia gpu on the host and the intel one on >> the windows 11 vm. >> >> Il sab 16 dic 2023, 18:11 Nuno Teixeira ha >> scritto: >> >> It seems that nvidia passtrhu isn't working (yet). >> >> Related to intel integrated graphics, I don't know if I can >> use it for ppt since it is in use by freebsd. >> Other thing, if I boot with BIOS on nvidia dedicated then >> intel doesn't show up in pciconf... >> >> Mario Marietto escreveu no dia >> sábado, 16/12/2023 à(s) 16:34: >> >> Are you trying to pass the nvidia gpu to windows vm ? or >> your intel gpu ? >> >> Il sab 16 dic 2023, 17:07 Nuno Teixeira >> ha scritto: >> >> Hello all, >> >> Specs: >> - laptop with integrated intel + dedicated nvidia >> - 15-CURRENT 3b1904d9eb04 amd64 >> - win11 with nvme and tpm >> >> I'm sharing my results with nvidia passthru: >> ### >> /boot/loader.conf.local: >> vmm_load="YES" >> pptdevs="1/0/0 1/0/1" >> >> ppt0@pci0:1:0:0:  class=0x030000 rev=0xa1 hdr=0x00 >> vendor=0x10de device=0x1f99 subvendor=0x17aa >> subdevice=0x3fa5 >>     vendor     = 'NVIDIA Corporation' >>     device     = 'TU117M [GeForce GTX 1650 Mobile / >> Max-Q]' >>     class      = display >>     subclass   = VGA >> ppt1@pci0:1:0:1:        class=0x040300 rev=0xa1 >> hdr=0x00 vendor=0x10de device=0x10fa subvendor=0x17aa >> subdevice=0x3ffb >>     vendor     = 'NVIDIA Corporation' >>     class      = multimedia >>     subclass   = HDA >> >> bhyve: >> -s 6:0,passthru,1/0/0 -s 6:1,passthru,1/0/1 >> ### >> >> - Installed nvidia drivers without problems >> - graphic card is detected but is deactivated with a >> triangle and a "!": >>   "Windows stopped this device... code 43" >> - hda is detected and shows no problem >> >> I've read that some nvidia cards are working... >> Any tips are welcome. >> >> Not sure if it is possible to use intel integrated as >> it is already in use by OS. >> >> Thanks, >> >> -- >> Nuno Teixeira >> FreeBSD Committer (ports) >> >> >> >> -- >> Nuno Teixeira >> FreeBSD Committer (ports) >> > Hello! > > i had just the same, here on illumos. > i didn't get it to work, but i had a similar problem with an AMD > card :-/ > > i think i will try it again in Jan/2024, and then with a fresh > install of windows... > > Do you use UEFI boot on both host and vm? > > Regards, > Stephan > > > > > -- > Mario. Hello! I have a AMD RX 6400. Is there a HCL for GPU passthrough ? Any HowTo for AMD card passthrough ? Is the AMD RX 6400 ht by the "RESET" hw bug ? Any hints are welcome :-) Regards, Stephan Althaus --------------9I0RBcySf4ErYgQA5o70nvKf Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: 8bit
On 12/17/23 11:51, Mario Marietto wrote:
AMD gpu works great with bhyve and they are recognized by a Windows vm.

On Sun, Dec 17, 2023 at 11:43 AM Stephan Althaus <Stephan.Althaus@duedinghausen.eu> wrote:
On 12/16/23 18:49, Mario Marietto wrote:
for sure you can use nVidia gpu on the host and the intel one on the windows 11 vm.

Il sab 16 dic 2023, 18:11 Nuno Teixeira <eduardo@freebsd.org> ha scritto:
It seems that nvidia passtrhu isn't working (yet).

Related to intel integrated graphics, I don't know if I can use it for ppt since it is in use by freebsd.
Other thing, if I boot with BIOS on nvidia dedicated then intel doesn't show up in pciconf...

Mario Marietto <marietto2008@gmail.com> escreveu no dia sábado, 16/12/2023 à(s) 16:34:
Are you trying to pass the nvidia gpu to windows vm ? or your intel gpu ?

Il sab 16 dic 2023, 17:07 Nuno Teixeira <eduardo@freebsd.org> ha scritto:
Hello all,

Specs:
- laptop with integrated intel + dedicated nvidia
- 15-CURRENT 3b1904d9eb04 amd64
- win11 with nvme and tpm

I'm sharing my results with nvidia passthru:
###
/boot/loader.conf.local:
vmm_load="YES"
pptdevs="1/0/0 1/0/1"

ppt0@pci0:1:0:0:        class=0x030000 rev=0xa1 hdr=0x00 vendor=0x10de device=0x1f99 subvendor=0x17aa subdevice=0x3fa5
    vendor     = 'NVIDIA Corporation'
    device     = 'TU117M [GeForce GTX 1650 Mobile / Max-Q]'
    class      = display
    subclass   = VGA
ppt1@pci0:1:0:1:        class=0x040300 rev=0xa1 hdr=0x00 vendor=0x10de device=0x10fa subvendor=0x17aa subdevice=0x3ffb
    vendor     = 'NVIDIA Corporation'
    class      = multimedia
    subclass   = HDA

bhyve:
-s 6:0,passthru,1/0/0 -s 6:1,passthru,1/0/1
###

- Installed nvidia drivers without problems
- graphic card is detected but is deactivated with a triangle and a "!":
  "Windows stopped this device... code 43"
- hda is detected and shows no problem

I've read that some nvidia cards are working...
Any tips are welcome.

Not sure if it is possible to use intel integrated as it is already in use by OS.

Thanks,

--
Nuno Teixeira
FreeBSD Committer (ports)


--
Nuno Teixeira
FreeBSD Committer (ports)

Hello!

i had just the same, here on illumos.
i didn't get it to work, but i had a similar problem with an AMD card :-/

i think i will try it again in Jan/2024, and then with a fresh install of windows...

Do you use UEFI boot on both host and vm?

Regards,
Stephan




--
Mario.

Hello!

I have a AMD RX 6400.

Is there a HCL for GPU passthrough ?
Any HowTo for AMD card passthrough ?

Is the AMD RX 6400 ht by the "RESET" hw bug ?


Any hints are welcome :-)


Regards,

Stephan Althaus


--------------9I0RBcySf4ErYgQA5o70nvKf-- From nobody Tue Dec 19 11:21:01 2023 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4SvZGX3fGLz554QD for ; Tue, 19 Dec 2023 11:29:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4SvZGW4hzpz3FRV for ; Tue, 19 Dec 2023 11:29:23 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1702985363; a=rsa-sha256; cv=none; b=R2O18g9ej4TiRUD2+bWPGkqNzBwj/uZe7pvN4liLvSbrjFzpVfmmjcrGZojMeldR/RjFk3 2wxKJ/ctZ/dQvzbhLqHA2iDkPE04nO1gJeRAZwfGdDd5VDi4yRPcG7VQYchxh9L+pv1JJ9 lZuPjb/RK4BtLBUswASJKprwtP6yHSdG4Gxd7X9BxXMV1VzEolltfhMpFZ1viYLRbRugnS cq4Gtdslb1Hc25zK9hoZZiBPURzk+grRMUW3sRLruUi0jg4oeB5oSD6AaDFk5jJTanPcDC N8TlPsJWz9Tk83r7n+Iw2MjP+EeVzmorl4MO9c7dMWw2QTYWOFxOVMFIlV3ERA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1702985363; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=A4S06pgZF2mxXKsfKFuYC5k9Qa1WxkNTlaV7HyqDOJs=; b=IvwxaYBxLTXXSxQ4laakiXRzgQy6NiqI2onPS2qx7AbPseNc9bKXacwiFL67XNLaCbJMeV PZipkYyIa7LkWjczCILxfi65+cW2MrvzUcL62HuBaJp6+VXruOgIWZ7rNQoZFmJ4UzmnX8 uGf51OYtNDKJJGg+/pYCmIwyAn8Fg0nnhZzlQd5bmLnur+vomE06u0J529+M8QCCGBH2z9 CHWvez95kZxfT+1dVbYY/mNvnX0sppuaCo1X6vNCy5kQi4OKqGXDJ5eqOVhC8BBnucOvsn JN6YTJ++lkPtDoFvtdXlhZ8xascwsag34XcLF4fex/d4OmR4Oib2Li7wPK7/kw== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4SvZGV4My6z139V for ; Tue, 19 Dec 2023 11:29:22 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 3BJBTJQZ046913 for ; Tue, 19 Dec 2023 11:29:22 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 3BJBL87M034875 for virtualization@FreeBSD.org; Tue, 19 Dec 2023 11:21:08 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 275760] bhyve: xhci not working on linux guests Date: Tue, 19 Dec 2023 11:21:01 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: 14.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grehan@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D275760 Peter Grehan changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |grehan@FreeBSD.org --- Comment #3 from Peter Grehan --- Created attachment 247158 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D247158&action= =3Dedit xhci mouse proposed fix Would you be able to try this patch ? Works on Ubuntu 23.10, and doesn't br= eak anything on Ubuntu 22.04 and Windows 10. As a side-effect it also fixes the error messages about port-power. The USB3 spec mandates that the endpoint size for super-speed devices is 51= 2, so the size field has to be 9, not 8. Linux only recently started checking this. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Dec 19 13:43:26 2023 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4SvdFS4mRGz54Gjt for ; Tue, 19 Dec 2023 13:43:40 +0000 (UTC) (envelope-from eduardo@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4SvdFS26Jfz3XHf for ; Tue, 19 Dec 2023 13:43:40 +0000 (UTC) (envelope-from eduardo@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1702993420; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=rMJRNDtyqzRFYrq8o31ss1nlFOdnr8YGcMAU+Y1otIc=; b=sdwOL69vkZafXWP+qxsnZQ+zSkXIA0stC6EAAaCTyPz4iMf4G/drF5C10MolOGTl3CNsD0 3Vnb5jlCrDuCReLQnZm364ubtHMmW7fqgFQfp9EgUKNpvxL6Y7Ek1ImfIg7lpvzRD7IP0p azDxr/FiHOMyvpi37WlrpoTEf+j6e8j3eVkXLVhb2uUX0tvpDP79rSnoM9RtjrPyNYwP/L j4encC9l2bfhydmgsIhq/HYU1SgKIOSUWRnlPQiiX8+rQ4QdXQ+HKF/mkTxZmcjWVGVLI3 piHO9kaw+IVCj1o66yaObkKZzQdjxKlhef5KpiMp5in/cwmipSVk4DKd0lPzkQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1702993420; a=rsa-sha256; cv=none; b=YKS9LNY+m48zg/KZqselLTF2wr9A/1E3yC656M64whFmalYhrxrK65eOkABXi5TfU8MwbD Hf3QVS4+6rkEIG+XhtkjaeFrRY0M8Oquh1MxwkdpkxzgEAVCLbeghYv3+VzpBKnhYDugP7 PTY9nHir0Z9Pq7TDYjr3Q4GV/NX/mLUBT0255fYSyrsOajfQhe/FXB6DmvK9VrDVNOivNn ob8ZFS7IbiA0FqO1DEHFfC8dY6+e30smk4C0vHm1YvuubGlcOfqcczypg/S1vnDr/+EzZW xa3YeiuhtnEq3ztuCdKUd8mgRf6FZ9FBU5Oz1xkOSPQhd/gCfMA22TfGGarlLA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1702993420; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=rMJRNDtyqzRFYrq8o31ss1nlFOdnr8YGcMAU+Y1otIc=; b=elkhXn98Gqi0bStWAocQmDMg3V4TRMgfc9Bdis9ryin1KhgdqxBq40bsruSKoslqEvRbt3 9DAkLUtGYOohwjQNmvWqzvHN8c/p9IZYQoCDonYgrhux/VPmmUypRvbXoamlNdo6BlsfG2 ssAvcjfgEiBIfUYvnly0be1Pk1B8mSX7AQbLAtcbGAwEaE/b0my4bUAf0p6uXPytZpM5l7 wrCoQFme5FsB0Fe0R52ZXoDpRNJN5xI/9B2YZdGMRkKwLx8c10kavxURrwQHMIj/+BuxX7 KdB1eQYuEgmGyoa39+W6wqLiGzeG7MrcQjM7HKzFmWhbh6WfMGlQPfBxZ4TR9g== Received: from mail-vs1-f48.google.com (mail-vs1-f48.google.com [209.85.217.48]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) (Authenticated sender: eduardo) by smtp.freebsd.org (Postfix) with ESMTPSA id 4SvdFS10CMz18Dc for ; Tue, 19 Dec 2023 13:43:40 +0000 (UTC) (envelope-from eduardo@freebsd.org) Received: by mail-vs1-f48.google.com with SMTP id ada2fe7eead31-466a4d46138so298930137.1 for ; Tue, 19 Dec 2023 05:43:40 -0800 (PST) X-Gm-Message-State: AOJu0Yyvuh+Bp8Oz5nIy/9HZY90s/7ssysAMOXQEH1/tDMoblpuzQsHu +SgpKGskc+ZvoGVP9QMmGac5H0L7ioCnEwhN8Pk= X-Google-Smtp-Source: AGHT+IEethDlrsJRkDz3M58ZKcFqXuLxhjJjFJvubNk1ChmvP0mSOXuqz4AqU22ZBcxAAubZVBqZaBsolfXLacIfPUI= X-Received: by 2002:a05:6102:3ca2:b0:466:a06f:5d3d with SMTP id c34-20020a0561023ca200b00466a06f5d3dmr1627059vsv.4.1702993419204; Tue, 19 Dec 2023 05:43:39 -0800 (PST) List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 References: <4c4dc909-9da6-41e0-99d1-72337a51484b@Duedinghausen.eu> In-Reply-To: <4c4dc909-9da6-41e0-99d1-72337a51484b@Duedinghausen.eu> From: Nuno Teixeira Date: Tue, 19 Dec 2023 13:43:26 +0000 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: bhyve nvidia gtx-1650 mobile passthru on win11 To: virtualization@freebsd.org Content-Type: multipart/alternative; boundary="000000000000ce9382060cdd0db2" --000000000000ce9382060cdd0db2 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable It's easy to configure and run a graphics passthru, https://wiki.freebsd.org/bhyve/pci_passthru gives that info. Stephan Althaus escreveu no dia ter=C3= =A7a, 19/12/2023 =C3=A0(s) 07:43: > On 12/17/23 11:51, Mario Marietto wrote: > > AMD gpu works great with bhyve and they are recognized by a Windows vm. > > On Sun, Dec 17, 2023 at 11:43=E2=80=AFAM Stephan Althaus < > Stephan.Althaus@duedinghausen.eu> wrote: > >> On 12/16/23 18:49, Mario Marietto wrote: >> >> for sure you can use nVidia gpu on the host and the intel one on the >> windows 11 vm. >> >> Il sab 16 dic 2023, 18:11 Nuno Teixeira ha scritto= : >> >>> It seems that nvidia passtrhu isn't working (yet). >>> >>> Related to intel integrated graphics, I don't know if I can use it for >>> ppt since it is in use by freebsd. >>> Other thing, if I boot with BIOS on nvidia dedicated then intel doesn't >>> show up in pciconf... >>> >>> Mario Marietto escreveu no dia s=C3=A1bado, >>> 16/12/2023 =C3=A0(s) 16:34: >>> >>>> Are you trying to pass the nvidia gpu to windows vm ? or your intel gp= u >>>> ? >>>> >>>> Il sab 16 dic 2023, 17:07 Nuno Teixeira ha >>>> scritto: >>>> >>>>> Hello all, >>>>> >>>>> Specs: >>>>> - laptop with integrated intel + dedicated nvidia >>>>> - 15-CURRENT 3b1904d9eb04 amd64 >>>>> - win11 with nvme and tpm >>>>> >>>>> I'm sharing my results with nvidia passthru: >>>>> ### >>>>> /boot/loader.conf.local: >>>>> vmm_load=3D"YES" >>>>> pptdevs=3D"1/0/0 1/0/1" >>>>> >>>>> ppt0@pci0:1:0:0: class=3D0x030000 rev=3D0xa1 hdr=3D0x00 >>>>> vendor=3D0x10de device=3D0x1f99 subvendor=3D0x17aa subdevice=3D0x3fa5 >>>>> vendor =3D 'NVIDIA Corporation' >>>>> device =3D 'TU117M [GeForce GTX 1650 Mobile / Max-Q]' >>>>> class =3D display >>>>> subclass =3D VGA >>>>> ppt1@pci0:1:0:1: class=3D0x040300 rev=3D0xa1 hdr=3D0x00 >>>>> vendor=3D0x10de device=3D0x10fa subvendor=3D0x17aa subdevice=3D0x3ffb >>>>> vendor =3D 'NVIDIA Corporation' >>>>> class =3D multimedia >>>>> subclass =3D HDA >>>>> >>>>> bhyve: >>>>> -s 6:0,passthru,1/0/0 -s 6:1,passthru,1/0/1 >>>>> ### >>>>> >>>>> - Installed nvidia drivers without problems >>>>> - graphic card is detected but is deactivated with a triangle and a >>>>> "!": >>>>> "Windows stopped this device... code 43" >>>>> - hda is detected and shows no problem >>>>> >>>>> I've read that some nvidia cards are working... >>>>> Any tips are welcome. >>>>> >>>>> Not sure if it is possible to use intel integrated as it is already i= n >>>>> use by OS. >>>>> >>>>> Thanks, >>>>> >>>>> -- >>>>> Nuno Teixeira >>>>> FreeBSD Committer (ports) >>>>> >>>> >>> >>> -- >>> Nuno Teixeira >>> FreeBSD Committer (ports) >>> >> Hello! >> >> i had just the same, here on illumos. >> i didn't get it to work, but i had a similar problem with an AMD card :-= / >> >> i think i will try it again in Jan/2024, and then with a fresh install o= f >> windows... >> >> Do you use UEFI boot on both host and vm? >> >> Regards, >> Stephan >> >> >> > > -- > Mario. > > Hello! > > I have a AMD RX 6400. > > Is there a HCL for GPU passthrough ? > Any HowTo for AMD card passthrough ? > > Is the AMD RX 6400 ht by the "RESET" hw bug ? > > > Any hints are welcome :-) > > > Regards, > > Stephan Althaus > > > --=20 Nuno Teixeira FreeBSD Committer (ports) --000000000000ce9382060cdd0db2 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
It's easy to configure and run a graphics passthr= u, https://wiki.fre= ebsd.org/bhyve/pci_passthru gives that info.

Stephan Althaus <= Stephan.Althaus@dueding= hausen.eu> escreveu no dia ter=C3=A7a, 19/12/2023 =C3=A0(s) 07:43:
=20 =20 =20
On 12/17/23 11:51, Mario Marietto wrote:
=20
AMD gpu works great with bhyve and they are recognized by a Windows vm.

On Sun, Dec 17, 2023 at 11:43=E2=80=AFAM Stephan Althaus <Stephan.Althaus@duedinghausen.eu<= /a>> wrote:
On 12/16/23 18:49, Mario Marietto wrote:
for sure you can use nVidia gpu on the host and the intel one on the windows 11 vm.

Il sab 16 dic 2023, 18:11 Nuno Teixeira <eduardo@freebsd.org> ha scritto:
It seems that nvidia passtrhu isn't working (yet).

Related to intel integrated graphics, I don't know if I can use it for ppt since it is in use by freebsd.
Other thing, if I boot with BIOS on nvidia dedicated then intel doesn't show up in pciconf..= .

Mario Marietto <marietto2008@gmail.com> escreveu no dia s=C3=A1bado, 16/12/2023 =C3=A0(s) 16:= 34:
Are you trying to pass the nvidia gpu to windows vm ? or your intel gpu ?

Il sab 16 dic 2023, 17:07 Nuno Teixeira <eduardo@freebsd.or= g> ha scritto:
Hello all,

Specs:
- laptop with integrated intel + dedicated nvidia
- 15-CURRENT 3b1904d9eb04 amd64
- win11 with nvme and tpm

I'm sharing my results with nvidia passthru:
###
/boot/loader.conf.local:
vmm_load=3D"YES"
pptdevs=3D"1/0/0 1/0/1"

ppt0@pci0:1:0:0: =C2=A0 =C2=A0 =C2=A0 =C2=A0class=3D0x030000 rev=3D0xa1 hdr=3D0x0= 0 vendor=3D0x10de device=3D0x1f99 subvendor=3D0x17aa subdevice=3D0x3fa5
=C2=A0 =C2=A0 vendor =C2=A0 =C2=A0 =3D '= ;NVIDIA Corporation'
=C2=A0 =C2=A0 device =C2=A0 =C2=A0 =3D '= ;TU117M [GeForce GTX 1650 Mobile / Max-Q]'
=C2=A0 =C2=A0 class =C2=A0 =C2=A0 =C2=A0=3D= display
=C2=A0 =C2=A0 subclass =C2=A0 =3D VGA
ppt1@pci0:1:0:1: =C2=A0 =C2=A0 =C2=A0 =C2= =A0class=3D0x040300 rev=3D0xa1 hdr=3D0x00 vendor=3D0x10de device=3D0x10fa subvendor=3D0x17aa subdevice=3D0x3ffb
=C2=A0 =C2=A0 vendor =C2=A0 =C2=A0 =3D '= ;NVIDIA Corporation'
=C2=A0 =C2=A0 class =C2=A0 =C2=A0 =C2=A0=3D= multimedia
=C2=A0 =C2=A0 subclass =C2=A0 =3D HDA

bhyve:
-s 6:0,passthru,1/0/0 -s 6:1,passthru,1/0/1
###

- Installed nvidia drivers without problems
- graphic card is detected but is deactivated with a triangle and a "!&q= uot;:
=C2=A0 "Windows stopped this device= ... code 43"
- hda is detected and shows no problem

I've read that some nvidia cards are working...
Any tips are welcome.

Not sure if it is possible to use intel integrated as it is already in use by OS.

Thanks,

--
Nuno Teixeira
FreeBSD Committer (ports)


--
Nuno Teixeira
FreeBSD Committer (ports)

Hello!

i had just the same, here on illumos.
i didn't get it to work, but i had a similar problem with an AMD card :-/

i think i will try it again in Jan/2024, and then with a fresh install of windows...

Do you use UEFI boot on both host and vm?

Regards,
Stephan




--
Mario.

Hello!

I have a AMD RX 6400.

Is there a HCL for GPU passthrough ?
Any HowTo for AMD card passthrough ?

Is the AMD RX 6400 ht by the "RESET" hw bug ?


Any hints are welcome :-)


Regards,

Stephan Althaus




--
Nuno Teixeira
FreeBSD Committ= er (ports)
--000000000000ce9382060cdd0db2-- From nobody Tue Dec 19 14:48:14 2023 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Svfh009K0z54MNV for ; Tue, 19 Dec 2023 14:48:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Svfgz174fz4X2R for ; Tue, 19 Dec 2023 14:48:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1702997295; a=rsa-sha256; cv=none; b=AcYXN979pLnl/iRNDM45RMtUSHyGCwKnc2KUADm407Rtg3ED1SL1JcbM3rXegcmCCzgvFD LMqUyAydwcD29Kr5km+oZcpFiso5/kTq+X/qDARG1Cvt3qWX7vdATjdOkZ31u3KAqwRoTE 6ljn4vrMvfhAcQkZCeoIrkU/HzoQwGAqfYxyiuphxV3oX3g+ahcD4u25J/fOMDwrJS2Tb5 ijFAndnSgse0Hhh4B1hrdUer29GwBnP35dYO/53qIMn3+S2dQBbftBsDGm8253eElvbbjt TzWD3NYwOltyWA7FfHMdpF7ab7fOo52JmA4i+RMZ/7R2nWtIiROb/oskFSp0Bw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1702997295; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=oSgWXvpG4V9iYVqpcfO4ju1JRpeNcCGCuuSrhDEfNFY=; b=X6AqZngWkcMtbkfcJTVeT+oZfH7pD/b1VmheQyMO4UURQGbk7hU40gsZFGsbRm3KHMn7r2 Wg2GHTcXpGTW5co4a35ZMEgHn7klJSxzCD9PG7KmifJE5JXB1mY0zkcmyp5c/WdbE8dch6 JZH6O9Napi5zJareyVza9lclpMeXDu8OhEq8nCqnsgRVadZIP0o/9s2L1G2KepfMKNdIBc WzfElFxMUXJU/yljJI/Tp8Ld5yoy4tKaLHnyFd1SnYz2cc7J5PU6dstVBv6JVoTV2SkzZa Yi13wNHxoGjCRO5CBwecydct9OPuT4dGXDNLfrNFFTHJaLM6qUzymSvVE9JwqA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Svfgy3Nz6z18DN for ; Tue, 19 Dec 2023 14:48:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 3BJEmEkG054413 for ; Tue, 19 Dec 2023 14:48:14 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 3BJEmEDP054412 for virtualization@FreeBSD.org; Tue, 19 Dec 2023 14:48:14 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 275760] bhyve: xhci not working on linux guests Date: Tue, 19 Dec 2023 14:48:14 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: 14.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: kempe@lysator.liu.se X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D275760 --- Comment #4 from Andreas Kempe --- (In reply to Peter Grehan from comment #3) This patch did the trick for my Gentoo VM running Linux 6.1.66 on 13.2-RELEASE-p8. No more errors in the dmesg and the mouse is working. Thank you! --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Dec 19 16:50:29 2023 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4SvjNj5sqgz54XSl for ; Tue, 19 Dec 2023 16:50:13 +0000 (UTC) (envelope-from Stephan.Althaus@Duedinghausen.eu) Received: from mo4-p05-ob.smtp.rzone.de (mo4-p05-ob.smtp.rzone.de [81.169.146.183]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "*.smtp.rzone.de", Issuer "Telekom Security ServerID OV Class 2 CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4SvjNh6Ddzz4WjQ for ; Tue, 19 Dec 2023 16:50:12 +0000 (UTC) (envelope-from Stephan.Althaus@Duedinghausen.eu) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=hoewweken.de header.s=strato-dkim-0002 header.b=IOwSYua1; dkim=pass header.d=hoewweken.de header.s=strato-dkim-0003 header.b=KMXyr2A2; spf=none (mx1.freebsd.org: domain of Stephan.Althaus@Duedinghausen.eu has no SPF policy when checking 81.169.146.183) smtp.mailfrom=Stephan.Althaus@Duedinghausen.eu; arc=pass ("strato.com:s=strato-dkim-0002:i=1"); dmarc=none ARC-Seal: i=1; a=rsa-sha256; t=1703004609; cv=none; d=strato.com; s=strato-dkim-0002; b=f6rKmKmW67qn6dnHvniCLxrJr93aWKd8+hTy0fqBBSAclcnmaupHdxURHlKTnvTeOp z7O0z0Dg782rxROVS8QMUGtbsNNB568tUA3HkAQGMj7nNZkZoOp2yIaPG41PtgDu7P1h tsaH1VCHiz+aJuIeiGMq1JE3fBb7lQ7j/RvWrB8DNup2XfeC0bR76fkOSCgkmyxuDJEb U86YOf4DKcY/r1iaCe8PQqibhAEUOQw7TZL6fhwEsXE2Y/ZZkVJ0Dnw+8TQYNPc1OGCx MlN9DdFreKgYlDc2syPbmPCFR2P1U3LYf8o7gqB7a0zgNLE6mpxA+fuXMXr/abwq390l JU7A== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; t=1703004609; s=strato-dkim-0002; d=strato.com; h=In-Reply-To:From:References:To:Subject:Date:Message-ID:Cc:Date:From: Subject:Sender; bh=Oe9Ko7WrpfUQIe0fp5V/HXu50FgkhYI60qvi4M9l6wU=; b=An9KP9mvxheQ19O8oUnJV2kDz4f9kFm0Rx+uLhjpL5jsijL2Mw2TqL573+7Myqc34f dncGXptFSCv+WMOaNZE37/UgERH52fKAxM849MDu6xK1HyOmJD8ieSdV0q0nPJAm00ns igGkTK/mozPnaybGvm2H41SDgFxeeyzcyw3ibYgHdhOfY9uC0QpfMs2/aHQIUb0Kvw1P IxqHoxxTAZ9o4NswWXtlcu5HhU/RcsV0ylrsYgrKiWz+gg7SjV27mqNIIt1grBLmmg8d HzubceYmh0LeyDNDlmvkXD+bRqQYDK3nNxmmfs1NilfDwrcHjE21kz6x1BO5ZscvH1Pl BJrQ== ARC-Authentication-Results: i=1; strato.com; arc=none; dkim=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; t=1703004609; s=strato-dkim-0002; d=hoewweken.de; h=In-Reply-To:From:References:To:Subject:Date:Message-ID:Cc:Date:From: Subject:Sender; bh=Oe9Ko7WrpfUQIe0fp5V/HXu50FgkhYI60qvi4M9l6wU=; b=IOwSYua1nbzoRIm3T3Kz15H4d1FPa0aYuewgMYFJqbYZ//k9n9FLM83Ax4YFWEp42+ tAsPIArJluhzPaJfadOjbaPqjNSEnI1WSVgzcWVWQF2lhxIoTCEj93XXmsihMtrFlHSj apGMC8yuMf1MCyjvgvC9Ds9OSoMAMzmR8449kNNGOQYhf/TUeazeX8NlfanxlteivJff 820VZ1ygEk/S95kNvuk6x3IE6RQwXWJVnLoRrawyUVOJME/2qprsmFFbxfkAEw8cPu8s 5L9UjpYT1f5f4CL888+Cfx44JhZl+hTdlBMLB85c3GOeqCVCCRmOe4i+RwE3j/OOXhPP rTKg== DKIM-Signature: v=1; a=ed25519-sha256; c=relaxed/relaxed; t=1703004609; s=strato-dkim-0003; d=hoewweken.de; h=In-Reply-To:From:References:To:Subject:Date:Message-ID:Cc:Date:From: Subject:Sender; bh=Oe9Ko7WrpfUQIe0fp5V/HXu50FgkhYI60qvi4M9l6wU=; b=KMXyr2A2eFp2qEbD9MCf0QwlPLFAsg2zuhMP86lNO0DrPXXZJV3/lXi6P+5KUgPKFs HQ5Q/7q9KnWzBRrdTtAw== X-RZG-AUTH: ":O2kGeEG7b/pS1EW2TmikjLDsYYueHLp2aWg0q38nsxN1mOntnRORP93PLpfReKNjbyYtOAegfjheaQ4=" X-RZG-CLASS-ID: mo05 Received: from www.duedinghausen.eu by smtp.strato.de (RZmta 49.10.0 DYNA|AUTH) with ESMTPSA id 9f0670zBJGo8NMh (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256 bits)) (Client did not present a certificate) for ; Tue, 19 Dec 2023 17:50:08 +0100 (CET) Received: from [192.168.2.63] (speedport.ip [192.168.1.1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (secp384r1) server-digest SHA384) (No client certificate requested) (Authenticated sender: steven) by www.duedinghausen.eu (Postfix) with ESMTPSA id 40DA612959A for ; Tue, 19 Dec 2023 17:49:41 +0100 (CET) Message-ID: Date: Tue, 19 Dec 2023 17:50:29 +0100 List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: bhyve nvidia gtx-1650 mobile passthru on win11 To: virtualization@freebsd.org References: <4c4dc909-9da6-41e0-99d1-72337a51484b@Duedinghausen.eu> Content-Language: en-US From: Stephan Althaus In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Spamd-Result: default: False [-4.38 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; ARC_ALLOW(-1.00)[strato.com:s=strato-dkim-0002:i=1]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.991]; R_DKIM_ALLOW(-0.20)[hoewweken.de:s=strato-dkim-0002,hoewweken.de:s=strato-dkim-0003]; RCVD_IN_DNSWL_LOW(-0.10)[81.169.146.183:from]; MIME_GOOD(-0.10)[text/plain]; XM_UA_NO_VERSION(0.01)[]; MLMMJ_DEST(0.00)[virtualization@freebsd.org]; ASN(0.00)[asn:6724, ipnet:81.169.144.0/22, country:DE]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; R_SPF_NA(0.00)[no SPF record]; DKIM_TRACE(0.00)[hoewweken.de:+]; RCPT_COUNT_ONE(0.00)[1]; RCVD_TLS_ALL(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; DMARC_NA(0.00)[duedinghausen.eu]; MID_RHS_MATCH_FROM(0.00)[]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[virtualization@freebsd.org]; RCVD_VIA_SMTP_AUTH(0.00)[] X-Rspamd-Queue-Id: 4SvjNh6Ddzz4WjQ X-Spamd-Bar: ---- On 12/19/23 14:43, Nuno Teixeira wrote: > It's easy to configure and run a graphics passthru, > https://wiki.freebsd.org/bhyve/pci_passthru gives that info. Yeah, up to that time when you encounter error 43. From nobody Wed Dec 20 02:02:50 2023 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4SvxfL6XcZz54Sdj for ; Wed, 20 Dec 2023 02:02:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4SvxfL5WR3z4M4G for ; Wed, 20 Dec 2023 02:02:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1703037770; a=rsa-sha256; cv=none; b=PRHIK6+ouvQ6le0imlGUV/2JFu/fbvW62CrBJQ/pSxOkpLNDGWaQOWXd86mOW5QugCAQmD ddYaGoMrDTydJakkxgFaBN3euMgonN+avvbziTbtBqeKx2NUWTBwp+EF5f9SI/Y2t1KEyz G/3H/RiTfZr8mkvKOkO64mvGjV9LSSRHQxhBr/D95a1naaouDWrjvDysRTZU27cGwe0ujS 8xCWz7wcgFLWiopoXbCnZgWF+oXZzflVRxtbER4o61IFxlqikycY1Kmf5WP7/axeLa1BoA gKGxqYCOgn20LwNBYM1Gf+D+VR4bZ9hkORGeCCTbBJZ1elUcO2JMVxyQwfSavw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1703037770; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=YhoH3CY2tm0X0JdGv/lzTuHxUkKGEvftWwoXYXREAVU=; b=AKYnCd5U6N2TDnMUch6KXFqRfv9SEu2yJWJnZTCLNIA84BTlMGXqGxgT9vuHs2oD2prUIP B6vxoKFcfgCrw8oQuxHisHiFOngafjoki+O+M0fP9Cn5UrOuWa1Hza3gqOVXzgzLzsGXjO QEls0fySMd+lz3AZGzxYuB0cS4IhMx9qclYhjqwf+broyzgwZIoB+tdJ1y3x0Yp1mzISR1 jiUe1scdRYIoa1XesKuJwB67lzMjZMqm2olqQZv1WGTaij3EKkM4ClbSHcc/xqGPZiKc3m UHHISo72wuJt+uPgnnonMMuCt0Mee49FaHfi8MpX3jipehUWj6neMS+1cZ3IAQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4SvxfL4ZsfzTvG for ; Wed, 20 Dec 2023 02:02:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 3BK22oIS069546 for ; Wed, 20 Dec 2023 02:02:50 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 3BK22oJl069545 for virtualization@FreeBSD.org; Wed, 20 Dec 2023 02:02:50 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 275760] bhyve: xhci not working on linux guests Date: Wed, 20 Dec 2023 02:02:50 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: 14.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: ath-fbsd@heybey.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D275760 Andrew Heybey changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |ath-fbsd@heybey.org --- Comment #5 from Andrew Heybey --- (In reply to Peter Grehan from comment #3) Thanks much, this patch also works for me. It fixes an Ubuntu 22.04 VM who= se mouse stopped working after a kernel upgrade a week or so ago. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Dec 20 10:02:12 2023 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Sw8Hj00T5z54l1R for ; Wed, 20 Dec 2023 10:02:25 +0000 (UTC) (envelope-from eduardo@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Sw8Hh6ZDDz4bsx; Wed, 20 Dec 2023 10:02:24 +0000 (UTC) (envelope-from eduardo@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1703066544; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=FJnJ1irS8gTEwAdz0mIXPPGpG/8qrzbfZauDF7c+1to=; b=uMPvITEZlV9O7sTCpiB0VlBicBYWpBPgnyKMst9TrktXrS0W87bM+Omcm8FS0Pb5RKSXXg NPV0Z4I+uv4HOkLLbyGJDlQIP5Bo1HDPKC/70ZqYZfgUrCRwY1kiy5BL+gHnwAqDJkaWAY LocuWDNnbiT/Eddr2AAfDUihRjd8di7W+0wNQaA9oWmhSyV3rwPtK0yKUrlMq9HNVikmv1 qjYHFYTEomfsWYRhXOzov8VrjkkwfmgqPwGGjkoAu+5tF4NfEGW4mCOHGX86/vCv4A7+dv UKfxzfAq0vFkm2wxxsg4Z7qRl5C5S7YypAte8NSIjpjAn4o1V/wUZgcZ/DWQsA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1703066544; a=rsa-sha256; cv=none; b=I+8RXagrc4igwWhwcvdLiLq1wD/TVYh05lgbFFemYRiGjWYKKe6dM5TkotMiOXlXaoefii NerEGmZD7AJxnvREyCfr12paJJvGnrXWyn1WeO4kmEFeeNeiJqEiJF6cGH01X38wE20/5w 2e5RePE9TG0M48QLs5ZqhQCw4b8dzJMIoiWM6SGISYTKwCNeAEC/cJS6b38KG7+RAkt+hk S8wxB4BXcWkLbq8eaDB6qMjgV7UQabtshovY6jwgx2RqKCMWHNFHSfXx2qcY57Tv3phWTR KZL5aYjxqakfdm8rPePxgyRebU6OJaLTu285AjOTtNL4rijIgZC2JP6OUSrabg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1703066544; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=FJnJ1irS8gTEwAdz0mIXPPGpG/8qrzbfZauDF7c+1to=; b=mBERtUXiVuwC4/oxJ1qkz37LTLV2jKt+mI1HI8n/NgFxlbCUQ1J/ZkNDoh4uINR82Wr0/1 xk0PEEKqDUTTSDq17vhVJnwFNwT0EpIlz7C63guyjItsJVSQkVOxp9ZTG1b1ja0aIaJJXu 4AE2c4A/CTo9RFjk5Du2dZAOklVcORvBI9aB2H4dI8zM34l8hVlsPDhIiG09NwDaiR1io3 13/ZZdtHborNrlifDdppFRVxSMWm1B+pzkwRen7uAkOVUGYdRwxiiZFUyBXDomtpqKUkbM 4L4j6xlq8X332FBROXm3MYTcWf9q7ypCkNmkrgi3XCElZlpQc5DP5/1XqsrfDg== Received: from mail-qt1-f179.google.com (mail-qt1-f179.google.com [209.85.160.179]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) (Authenticated sender: eduardo) by smtp.freebsd.org (Postfix) with ESMTPSA id 4Sw8Hh5VbXz66q; Wed, 20 Dec 2023 10:02:24 +0000 (UTC) (envelope-from eduardo@freebsd.org) Received: by mail-qt1-f179.google.com with SMTP id d75a77b69052e-425cbee636fso52564581cf.0; Wed, 20 Dec 2023 02:02:24 -0800 (PST) X-Gm-Message-State: AOJu0YyNVfEsUOVF8JdwzmT1eZWRJislRK5BOmynJrh8xtEVxhR/L+q1 pC12HkXxK3Mc6N22jv56wAVBAB5MBBbzdhMydTQ= X-Google-Smtp-Source: AGHT+IH9nEma7FmSY7UrWtcsTCzD2e4C068y51sFDmIaaM30YcFykOziqMX+pHItXvVu1LWw2wMt4NukdJY8pHs1Wh0= X-Received: by 2002:a05:622a:40f:b0:425:8396:3ba2 with SMTP id n15-20020a05622a040f00b0042583963ba2mr27534458qtx.126.1703066543897; Wed, 20 Dec 2023 02:02:23 -0800 (PST) List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 References: <101df7552fd1673ddc73e14daf518630402129c4.camel@FreeBSD.org> In-Reply-To: <101df7552fd1673ddc73e14daf518630402129c4.camel@FreeBSD.org> From: Nuno Teixeira Date: Wed, 20 Dec 2023 10:02:12 +0000 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: bhyve nvidia gtx-1650 mobile passthru on win11 To: =?UTF-8?Q?Corvin_K=C3=B6hne?= Cc: FreeBSD virtualization Content-Type: multipart/alternative; boundary="00000000000060c343060cee142a" --00000000000060c343060cee142a Content-Type: text/plain; charset="UTF-8" Hi Corvin, intel: > Requires a patched EDKII firmware [3]. Unfortunately, it's not merged > yet. Btw. even if you only have an Intel card available you can use it > for GPU passthrough. I'm runing a laptop with intel graphics dynamics + dedicated nvidia (Lenovo Legion 5i) and I'm thinking giving a try intel passtrhu: ### vgapci1@pci0:*0:2:0*: class=0x030000 rev=0x05 hdr=0x00 vendor=0x8086 device=0x9bc4 subvendor=0x17aa subdevice=0x3fa5 vendor = 'Intel Corporation' device = 'CometLake-H GT2 [UHD Graphics]' class = display subclass = VGA vgapci0@pci0:*1:0:0*: class=0x030000 rev=0xa1 hdr=0x00 vendor=0x10de device=0x1f99 subvendor=0x17aa subdevice=0x3fa5 vendor = 'NVIDIA Corporation' device = 'TU117M [GeForce GTX 1650 Mobile / Max-Q]' class = display subclass = VGA ### /boot/loader.conf: vmm_load="YES" pptdevs="*0/2/0*" etc/X11/xorg.conf.d/20-drivers.conf: Section "Device" Identifier "Card0" Driver "nvidia" BusID "PCI:*1:0:0*" EndSection bhyve: -s 6:0,passthru,*0/2/0* (vm-bhyve vm config: passthru0="*0/2/0*") I've already did this: - ppt gets configured for intel - xorg doesn't start with xorg "nvidia" config - xorg starts with scfb (with empty xorg config) - start vm and crashes my laptop I'm just looking for the correct setup to try it again when EDKII firmware gets updated/patched. Thanks, -- Nuno Teixeira FreeBSD Committer (ports) --00000000000060c343060cee142a Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hi Corvin,

intel:
Requires a patched EDKII firmware [3]. Unfortunately, it's not merged yet. Btw. even if you only have an Intel card available you can use it
for GPU passthrough.

I'm runing a lapto= p with intel graphics dynamics=C2=A0+ dedicated nvidia (Lenovo Legion 5i) a= nd I'm thinking giving a try intel passtrhu:

###
vgapci1@pci0:0:2:0: =C2=A0 =C2=A0 class=3D0x03= 0000 rev=3D0x05 hdr=3D0x00 vendor=3D0x8086 device=3D0x9bc4 subvendor=3D0x17= aa subdevice=3D0x3fa5
=C2=A0 =C2=A0 vendor =C2=A0 =C2=A0 =3D 'Intel = Corporation'
=C2=A0 =C2=A0 device =C2=A0 =C2=A0 =3D 'CometLake-H= GT2 [UHD Graphics]'
=C2=A0 =C2=A0 class =C2=A0 =C2=A0 =C2=A0=3D dis= play
=C2=A0 =C2=A0 subclass =C2=A0 =3D VGA

vgap= ci0@pci0:1:0:0: =C2=A0 =C2=A0 class=3D0x030000 rev=3D0xa1 hdr=3D0x00= vendor=3D0x10de device=3D0x1f99 subvendor=3D0x17aa subdevice=3D0x3fa5
= =C2=A0 =C2=A0 vendor =C2=A0 =C2=A0 =3D 'NVIDIA Corporation'
=C2= =A0 =C2=A0 device =C2=A0 =C2=A0 =3D 'TU117M [GeForce GTX 1650 Mobile / = Max-Q]'
=C2=A0 =C2=A0 class =C2=A0 =C2=A0 =C2=A0=3D display
=C2= =A0 =C2=A0 subclass =C2=A0 =3D VGA
###

/= boot/loader.conf:
vmm_load=3D"YES"
pptdevs=3D"<= b>0/2/0"

etc/X11/xorg.conf.d/20-drivers.c= onf:
Section "Device"
=C2=A0=C2=A0=C2=A0 Identifier = "Card0"
=C2=A0=C2=A0=C2=A0 Driver "nvidia"
=C2=A0= =C2=A0=C2=A0 BusID =C2=A0"PCI:1:0:0"
EndSection

bhyve:
-s 6:0,passthru,0/2/0
(= vm-bhyve vm config:
=C2=A0passthru0=3D"0/2/0")

I've already did this:=C2=A0
- ppt ge= ts configured for intel
- xorg doesn't start with xorg "= nvidia" config
- xorg starts with scfb (with empty xorg conf= ig)
- start vm and crashes my laptop

I'm ju= st looking for the correct setup to try it again when EDKII firmware gets u= pdated/patched.

Thanks,
--
Nuno = Teixeira
FreeBSD Committer (ports)
--00000000000060c343060cee142a-- From nobody Wed Dec 20 19:58:11 2023 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4SwPVq3sThz55HcB for ; Wed, 20 Dec 2023 19:57:55 +0000 (UTC) (envelope-from Stephan.Althaus@Duedinghausen.eu) Received: from mo4-p05-ob.smtp.rzone.de (mo4-p05-ob.smtp.rzone.de [81.169.146.183]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "*.smtp.rzone.de", Issuer "Telekom Security ServerID OV Class 2 CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4SwPVp24yRz3Lwx for ; Wed, 20 Dec 2023 19:57:54 +0000 (UTC) (envelope-from Stephan.Althaus@Duedinghausen.eu) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=hoewweken.de header.s=strato-dkim-0002 header.b=P+7TlcHk; dkim=pass header.d=hoewweken.de header.s=strato-dkim-0003 header.b=9dO8DvxH; spf=none (mx1.freebsd.org: domain of Stephan.Althaus@Duedinghausen.eu has no SPF policy when checking 81.169.146.183) smtp.mailfrom=Stephan.Althaus@Duedinghausen.eu; arc=pass ("strato.com:s=strato-dkim-0002:i=1"); dmarc=none ARC-Seal: i=1; a=rsa-sha256; t=1703102271; cv=none; d=strato.com; s=strato-dkim-0002; b=jL0vhRWdrPG1U18SGeMNGaizh2btCvFWWCJxWYVn+JeiVUwmxYDZoKqrFCmcetIKNb gojGLzUI9DRq7vlT57h1Nz87REvJmSTC6VyYyoEi8N0qSsD60X6dTLN+h/FVCv34am5m As/zmvw3isDsTnnb2xgW3Sg7oIsNQGJc+ly24wVPyw3zXeiVgoAS8Op3piDETITeNhtG RtttM04XZ2o2wCr7W0f1+/hcU7FgnlEhv/q0mnI/8CLuI2cVkxrxgcl33w+tZ3Y1hu0C GJSRVk3UGjkWF7MoH9YFECNdtnGWcAKJPt/4q3LZWaY2i4Hr53qoyPGMnpDZYAON2HAm dOEA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; t=1703102271; s=strato-dkim-0002; d=strato.com; h=In-Reply-To:From:References:To:Subject:Date:Message-ID:Cc:Date:From: Subject:Sender; bh=g53SQTTYolt9Q60F/V/b/3WgASnpUKp7N1Vqpp9en0w=; b=NuWHoyDIkqHj/S+796RCej6UBs/y6auhFj2hpt6btEhMEBIW5G5XNQCo6s4HF9K331 K7t0aIY0jlOU9KuqVCONckE3jRgFU0lyKezBpXlN6LmAp9orztRF5PE8OwoYN3EsXs5W g9Op7ZYNPa9sZCilrgpfnhvP6cWfeKRqx9FVSJt8Ze9RKsJbiELmIUoiL3Z/ACvmmm0v //xLqLWw6nH9Opf3LP5tWUboo6svDLxn7r9djF1zlITpJ2kW7Dts08E+j1WlrNwFBzRe fvu5qzmaf1E0TnRd/GvD6JNoX3DEI9AxxlqQqRKmGJGweq9deTn6nYUZcBJxpOQci8jz +Xqw== ARC-Authentication-Results: i=1; strato.com; arc=none; dkim=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; t=1703102271; s=strato-dkim-0002; d=hoewweken.de; h=In-Reply-To:From:References:To:Subject:Date:Message-ID:Cc:Date:From: Subject:Sender; bh=g53SQTTYolt9Q60F/V/b/3WgASnpUKp7N1Vqpp9en0w=; b=P+7TlcHkKWoNv3wZs/o4iBmh+GHXF37H5E+o4Jsq3E+SQBDwmlWVpI6lj+5EVH5Has 92zR3dpT8NZIQJT/TeqtQ4NTuSoP/G7NBRn/HJVfdmdWfDlSmb71PIahazizRbk5uonQ I7emTr9gGII0gWeFkpTiMyl53XBGi8H4sCFrPH+xgnaCspl7eiyFX8GRhUR+vPCavKZD FpnM8FjuEhQRbVijqS460NvO8AEp2ctM0Bs3CbjsnVW3sDHSZL8Q8nNnQhMK/lHhQNw5 C90S1XGnwJXdBIeeYIBmwLegjnSJiwJxA9dony1SqDRJUvK3L6v67F6PKiYehyFw2Bfk kLqQ== DKIM-Signature: v=1; a=ed25519-sha256; c=relaxed/relaxed; t=1703102271; s=strato-dkim-0003; d=hoewweken.de; h=In-Reply-To:From:References:To:Subject:Date:Message-ID:Cc:Date:From: Subject:Sender; bh=g53SQTTYolt9Q60F/V/b/3WgASnpUKp7N1Vqpp9en0w=; b=9dO8DvxHGC4AtipQyjWr0/M8r2mZtUXnjSx2GFUo0qa1/dpdk11/sBOgFI/RQt4UlW HQTVOpyECNppoXx1YmBw== X-RZG-AUTH: ":O2kGeEG7b/pS1EW2TmikjLDsYYueHLp2aWg0q38nsxN1mOntnRORP93PLpfReKNjbyYtOAegfjheaQ4=" X-RZG-CLASS-ID: mo05 Received: from www.duedinghausen.eu by smtp.strato.de (RZmta 49.10.0 DYNA|AUTH) with ESMTPSA id 9f0670zBKJvpYkz (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256 bits)) (Client did not present a certificate) for ; Wed, 20 Dec 2023 20:57:51 +0100 (CET) Received: from [192.168.2.63] (speedport.ip [192.168.1.1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (secp384r1) server-digest SHA384) (No client certificate requested) (Authenticated sender: steven) by www.duedinghausen.eu (Postfix) with ESMTPSA id 6627912967E for ; Wed, 20 Dec 2023 20:57:22 +0100 (CET) Content-Type: multipart/alternative; boundary="------------CkjYLm7QgfR5C6Sb0fBllNV3" Message-ID: <6837a1f2-9b28-4a49-8db6-f410853518e2@Duedinghausen.eu> Date: Wed, 20 Dec 2023 20:58:11 +0100 List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: bhyve nvidia gtx-1650 mobile passthru on win11 To: virtualization@freebsd.org References: <101df7552fd1673ddc73e14daf518630402129c4.camel@FreeBSD.org> Content-Language: en-US From: Stephan Althaus In-Reply-To: Content-Transfer-Encoding: 8bit X-Spamd-Result: default: False [-4.39 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; ARC_ALLOW(-1.00)[strato.com:s=strato-dkim-0002:i=1]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[hoewweken.de:s=strato-dkim-0002,hoewweken.de:s=strato-dkim-0003]; RCVD_IN_DNSWL_LOW(-0.10)[81.169.146.183:from]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; XM_UA_NO_VERSION(0.01)[]; MLMMJ_DEST(0.00)[virtualization@freebsd.org]; ASN(0.00)[asn:6724, ipnet:81.169.144.0/22, country:DE]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; R_SPF_NA(0.00)[no SPF record]; DKIM_TRACE(0.00)[hoewweken.de:+]; RCPT_COUNT_ONE(0.00)[1]; RCVD_TLS_ALL(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; DMARC_NA(0.00)[duedinghausen.eu]; MID_RHS_MATCH_FROM(0.00)[]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[virtualization@freebsd.org]; RCVD_VIA_SMTP_AUTH(0.00)[] X-Rspamd-Queue-Id: 4SwPVp24yRz3Lwx X-Spamd-Bar: ---- This is a multi-part message in MIME format. --------------CkjYLm7QgfR5C6Sb0fBllNV3 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit On 12/20/23 11:02, Nuno Teixeira wrote: > Hi Corvin, > > intel: > Requires a patched EDKII firmware [3]. Unfortunately, it's not merged > yet. Btw. even if you only have an Intel card available you can use it > for GPU passthrough. > > > I'm runing a laptop with intel graphics dynamics + dedicated nvidia > (Lenovo Legion 5i) and I'm thinking giving a try intel passtrhu: > > ### > vgapci1@pci0:*0:2:0*:     class=0x030000 rev=0x05 hdr=0x00 > vendor=0x8086 device=0x9bc4 subvendor=0x17aa subdevice=0x3fa5 >     vendor     = 'Intel Corporation' >     device     = 'CometLake-H GT2 [UHD Graphics]' >     class      = display >     subclass   = VGA > > vgapci0@pci0:*1:0:0*:     class=0x030000 rev=0xa1 hdr=0x00 > vendor=0x10de device=0x1f99 subvendor=0x17aa subdevice=0x3fa5 >     vendor     = 'NVIDIA Corporation' >     device     = 'TU117M [GeForce GTX 1650 Mobile / Max-Q]' >     class      = display >     subclass   = VGA > ### > > /boot/loader.conf: > vmm_load="YES" > pptdevs="*0/2/0*" > > etc/X11/xorg.conf.d/20-drivers.conf: > Section "Device" >     Identifier "Card0" >     Driver "nvidia" >     BusID  "PCI:*1:0:0*" > EndSection > > bhyve: > -s 6:0,passthru,*0/2/0* > (vm-bhyve vm config: >  passthru0="*0/2/0*") > > I've already did this: > - ppt gets configured for intel > - xorg doesn't start with xorg "nvidia" config > - xorg starts with scfb (with empty xorg config) > - start vm and crashes my laptop > > I'm just looking for the correct setup to try it again when EDKII > firmware gets updated/patched. > > Thanks, > -- > Nuno Teixeira > FreeBSD Committer (ports) Hi Nuno! If the laptops GPU setup is like "optimus" you will encounter problems runing Xorg on your nvidia GPU. I have a DELL 7720 with dedicated physical ports from the nvidia card to the display output(s), running Xorg on nvidia here but having the intel part _disabled_ in BIOS. These mobile dual GPU setups aren't that easy like multiple PCIe cards in a desktop "PC"... But maybe there is a solution for your laptop somewhere.. Regards, Stephan --------------CkjYLm7QgfR5C6Sb0fBllNV3 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: 8bit
On 12/20/23 11:02, Nuno Teixeira wrote:
Hi Corvin,

intel:
Requires a patched EDKII firmware [3]. Unfortunately, it's not merged
yet. Btw. even if you only have an Intel card available you can use it
for GPU passthrough.

I'm runing a laptop with intel graphics dynamics + dedicated nvidia (Lenovo Legion 5i) and I'm thinking giving a try intel passtrhu:

###
vgapci1@pci0:0:2:0:     class=0x030000 rev=0x05 hdr=0x00 vendor=0x8086 device=0x9bc4 subvendor=0x17aa subdevice=0x3fa5
    vendor     = 'Intel Corporation'
    device     = 'CometLake-H GT2 [UHD Graphics]'
    class      = display
    subclass   = VGA

vgapci0@pci0:1:0:0:     class=0x030000 rev=0xa1 hdr=0x00 vendor=0x10de device=0x1f99 subvendor=0x17aa subdevice=0x3fa5
    vendor     = 'NVIDIA Corporation'
    device     = 'TU117M [GeForce GTX 1650 Mobile / Max-Q]'
    class      = display
    subclass   = VGA
###

/boot/loader.conf:
vmm_load="YES"
pptdevs="0/2/0"

etc/X11/xorg.conf.d/20-drivers.conf:
Section "Device"
    Identifier "Card0"
    Driver "nvidia"
    BusID  "PCI:1:0:0"
EndSection

bhyve:
-s 6:0,passthru,0/2/0
(vm-bhyve vm config:
 passthru0="0/2/0")

I've already did this: 
- ppt gets configured for intel
- xorg doesn't start with xorg "nvidia" config
- xorg starts with scfb (with empty xorg config)
- start vm and crashes my laptop

I'm just looking for the correct setup to try it again when EDKII firmware gets updated/patched.

Thanks,
--
Nuno Teixeira
FreeBSD Committer (ports)

Hi Nuno!
If the laptops GPU setup is like "optimus" you will encounter problems runing Xorg on your nvidia GPU.
I have a DELL 7720 with dedicated physical ports from the nvidia card to the display output(s), running Xorg on nvidia here but having the intel part _disabled_ in BIOS.
These mobile dual GPU setups aren't that easy like multiple PCIe cards in a desktop "PC"...

But maybe there is a solution for your laptop somewhere..

Regards,
Stephan

--------------CkjYLm7QgfR5C6Sb0fBllNV3-- From nobody Thu Dec 21 04:36:08 2023 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Swd0n4Xz4z54H98 for ; Thu, 21 Dec 2023 04:36:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Swd0n3RTCz4ZfS for ; Thu, 21 Dec 2023 04:36:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1703133369; a=rsa-sha256; cv=none; b=a/cd6SB9GwJs+l+GuLE+KwhUpK8971gLk+lXO1vJ5z8MBpEy7kl+9xuD5B3uBa/NKqoovr yj9Jl6dYEjER0Vknei5dn0CjDkuAglUkNdczl7DW2FXe160F8JC782zPItdlPc0ekHQ80M VgWT76879MWVSJlov+kLsZTyXaPBlUfY0bELn00ae62lubWGh5s6WmGy/UzU58XKf1n7Cv lMWCWjkfNfv+L0lpZhjKXNkOwn49jHnUGLCyugPFuPilnlPVU8dhvS7iFZF/RV5M1qWlA6 esxK2KZ47FPthjGRb4/I+t8w2fdJn5Wh3XVFfqUeRq8XlS0F//BBv0TgKkqCng== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1703133369; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=0iYP52nxFEWTAcx3OiIxvKByhq+QrA7uAdBOmMIAwOA=; b=OMH0t5dt/nWNA5PLSh9FhWCOg39+Y5KRhvl7drFJsPTJBQOxzLoeJ6TKSWCuvPN5CwP49l Z226U1IUroaesD17I3Eow44fJijf7Xc9bFslGnUw7VxPfOzxXH8K/Lg4VWheTvTwDXAD4e VSOJm8q42x588pU2M3uarZ+uxYvZEGJ0ZTQLBb/NLnmHrrB1P00KOmIp2ZtavbNmeERxTy X9bvNTSpFKxvQgvfODm2vPL8BdZGUDAbiF3wbiiX8+8GzBx2g/u1XRFy6WvujpjX9KTlTe IH4ML2snDDZT2SvOtblWHl3CQ4QXMX81ud7MQ1RTVE589s2YWJ6fw0bH6sh1UQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Swd0n2WpLz3kg for ; Thu, 21 Dec 2023 04:36:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 3BL4a90j002956 for ; Thu, 21 Dec 2023 04:36:09 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 3BL4a9Jr002955 for virtualization@FreeBSD.org; Thu, 21 Dec 2023 04:36:09 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 275760] bhyve: xhci not working on linux guests Date: Thu, 21 Dec 2023 04:36:08 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: 14.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: slava@planetslav.ca X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D275760 --- Comment #6 from Slava --- (In reply to Peter Grehan from comment #3) The patch is working for me on Fedora 39. Thank you very much Peter! --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Dec 21 07:50:28 2023 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4SwjKD0hzSz54THv for ; Thu, 21 Dec 2023 07:50:40 +0000 (UTC) (envelope-from eduardo@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4SwjKC6sryz3HrB for ; Thu, 21 Dec 2023 07:50:39 +0000 (UTC) (envelope-from eduardo@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1703145040; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=SmpY2HVj0HHTDmab0TZkT8SHfeYS1Hhuly0zwFOxKUU=; b=jQszv+wn7APQB5D/DjMJqADQ71IXWuP8SFV7bi5OvgW4kY4nP/bbKhRo779CEf8AVJV2go toYEcPHkGpiU/SbrFBuu+ZqhaTXr6iCHP+2YhM1PWUb3sixjGl4NNPnIpCUGgH3L7s12ta eBDssnVDtEjTE9eyaEjMfKvj+HQavN2uuAjxJjVja96eJDsSHSktA3UyX6mq6j0mTHJzII mxOPG1nkJy2Pql1dkwcOhB+JBkKIX323EnrohHj8XNcGRv1pDGiygQfG/rN1XSkVzMUTlK U8OlrcDpqyHbdn0ikyz6icwCBd0oCRIrJ7GxZEc6JRtJW61xt7SDTG/MiYE8Og== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1703145040; a=rsa-sha256; cv=none; b=eGZGtw198xpvAkAk7DsbFz9D7fGT8bAYuPBT3tBifAfvA+w38wcWpQpBmXd7wcY8eys8eD BcAIrBdntaYbUV4KJc9fniR/zEpfSHOxL5Y47vGzCMRm477iNMU6PBXTpMesKYECBUMeSP umK3favwfS4TZPcEFJl5iERxvJA3sEJwDOatPUtgtydZtlqf8FpnXdTbJ/kitj4U1GlckA +nOziashIEclTlFRWmo8IKrW+AA16f0QuRDDsAJwZ9bb80BQEHNpCrCfx3UIyNPlwZXtV/ xSjjBoLFjkV+Ppb4dqJKEAuU3RWW2s6aMEeLqH0kFUIbzmG/6fV97HlEooLfyw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1703145040; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=SmpY2HVj0HHTDmab0TZkT8SHfeYS1Hhuly0zwFOxKUU=; b=Yj3y0zFbwo8lsZy15xsITuouHAJAnRIQqfGtPDAWKclRiY4FngkZqOqPdhGqi+zxXZj2jS ubo4TiOtpmMVKlWwCyjsFRG/uccHtIIPm7xkNeJtwKH9s8auBM2YQbaBoTMKfUnZUSSaqk UEP6uTibyzcGa7m7b6qWyGdRT6iBOelTq8o0MbtiDq4tvxvolGTVv1gVY8V8SniMVRtfo/ r6SbPkPz+hPk8RYzdVqVbAGWb8KeWLb6RXpcOzPlAhdPNZHdi1pyJRVog8VIHcMUz1jXvg rGMyCS9hpLrDf3Nqll+NsiQIrkQAtSrElNt+iSKjGS5Asl81BFwJNQ5H41C4tQ== Received: from mail-qt1-f175.google.com (mail-qt1-f175.google.com [209.85.160.175]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) (Authenticated sender: eduardo) by smtp.freebsd.org (Postfix) with ESMTPSA id 4SwjKC5pc6z11WC for ; Thu, 21 Dec 2023 07:50:39 +0000 (UTC) (envelope-from eduardo@freebsd.org) Received: by mail-qt1-f175.google.com with SMTP id d75a77b69052e-4277c62426fso3187291cf.1 for ; Wed, 20 Dec 2023 23:50:39 -0800 (PST) X-Gm-Message-State: AOJu0YzOhFTF/xzbZr1PIuBK4rGuesQTcyq/oVJ4iXkvth3VX2FKj42m Jhdyum35BIiilpL64w8WtYZzr7OfLGGgGL4DS4w= X-Google-Smtp-Source: AGHT+IEbXuIcamYsK9BgTMcodROw7hoByXcKHacZWzHyPf1FXum0UQQ5+SjJvIh2w+JpgAY6/CYbx0EvOGXI7+w+7o8= X-Received: by 2002:a05:622a:181b:b0:425:4043:1d91 with SMTP id t27-20020a05622a181b00b0042540431d91mr5754088qtc.100.1703145039241; Wed, 20 Dec 2023 23:50:39 -0800 (PST) List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 References: <101df7552fd1673ddc73e14daf518630402129c4.camel@FreeBSD.org> <6837a1f2-9b28-4a49-8db6-f410853518e2@Duedinghausen.eu> In-Reply-To: <6837a1f2-9b28-4a49-8db6-f410853518e2@Duedinghausen.eu> From: Nuno Teixeira Date: Thu, 21 Dec 2023 07:50:28 +0000 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: bhyve nvidia gtx-1650 mobile passthru on win11 To: virtualization@freebsd.org Content-Type: multipart/alternative; boundary="00000000000010a810060d005b76" --00000000000010a810060d005b76 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hello Stephan, Yes, I can't run nvidia when "dynamic graphics" are enabled on bios, but I will continue to search if there is some config tweak for it. I've just found and I'm reading about a setup identical to mine (hybrid mode): https://forums.freebsd.org/threads/how-to-nvidia-in-hybrid-mode.90473/ I will post my results soon. Cheers, Stephan Althaus escreveu no dia quarta, 20/12/2023 =C3=A0(s) 19:58: > On 12/20/23 11:02, Nuno Teixeira wrote: > > Hi Corvin, > > intel: >> Requires a patched EDKII firmware [3]. Unfortunately, it's not merged >> yet. Btw. even if you only have an Intel card available you can use it >> for GPU passthrough. > > > I'm runing a laptop with intel graphics dynamics + dedicated nvidia > (Lenovo Legion 5i) and I'm thinking giving a try intel passtrhu: > > ### > vgapci1@pci0:*0:2:0*: class=3D0x030000 rev=3D0x05 hdr=3D0x00 vendor= =3D0x8086 > device=3D0x9bc4 subvendor=3D0x17aa subdevice=3D0x3fa5 > vendor =3D 'Intel Corporation' > device =3D 'CometLake-H GT2 [UHD Graphics]' > class =3D display > subclass =3D VGA > > vgapci0@pci0:*1:0:0*: class=3D0x030000 rev=3D0xa1 hdr=3D0x00 vendor= =3D0x10de > device=3D0x1f99 subvendor=3D0x17aa subdevice=3D0x3fa5 > vendor =3D 'NVIDIA Corporation' > device =3D 'TU117M [GeForce GTX 1650 Mobile / Max-Q]' > class =3D display > subclass =3D VGA > ### > > /boot/loader.conf: > vmm_load=3D"YES" > pptdevs=3D"*0/2/0*" > > etc/X11/xorg.conf.d/20-drivers.conf: > Section "Device" > Identifier "Card0" > Driver "nvidia" > BusID "PCI:*1:0:0*" > EndSection > > bhyve: > -s 6:0,passthru,*0/2/0* > (vm-bhyve vm config: > passthru0=3D"*0/2/0*") > > I've already did this: > - ppt gets configured for intel > - xorg doesn't start with xorg "nvidia" config > - xorg starts with scfb (with empty xorg config) > - start vm and crashes my laptop > > I'm just looking for the correct setup to try it again when EDKII firmwar= e > gets updated/patched. > > Thanks, > -- > Nuno Teixeira > FreeBSD Committer (ports) > > Hi Nuno! > If the laptops GPU setup is like "optimus" you will encounter problems > runing Xorg on your nvidia GPU. > I have a DELL 7720 with dedicated physical ports from the nvidia card to > the display output(s), running Xorg on nvidia here but having the intel > part _disabled_ in BIOS. > These mobile dual GPU setups aren't that easy like multiple PCIe cards in > a desktop "PC"... > > But maybe there is a solution for your laptop somewhere.. > > Regards, > Stephan > > --=20 Nuno Teixeira FreeBSD Committer (ports) --00000000000010a810060d005b76 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hello Stephan,

Yes, I can= 9;t run nvidia when "dynamic graphics" are enabled on bios, but I= will continue to search if there is some config tweak for it.

I've just found and I'm reading about a setup iden= tical to mine (hybrid mode):

I w= ill post my results soon.

Cheers,
<= br>
Stephan= Althaus <Stephan.Al= thaus@duedinghausen.eu> escreveu no dia quarta, 20/12/2023 =C3=A0(s)= 19:58:
=20 =20 =20
On 12/20/23 11:02, Nuno Teixeira wrote:
=20
Hi Corvin,

intel:
Requires a patched EDKII firmware [3]. Unfortunately, it's not merged
yet. Btw. even if you only have an Intel card available you can use it
for GPU passthrough.

I'm runing a laptop with intel graphics dynamics=C2=A0+ dedicated nvidia (Lenovo Legion 5i) and I'm thinking giving a try intel passtrhu:

###
vgapci1@pci0:0:2:0: =C2=A0 =C2=A0 class=3D0x030000 r= ev=3D0x05 hdr=3D0x00 vendor=3D0x8086 device=3D0x9bc4 subvendor=3D0x17aa subdevice=3D0x3fa5
=C2=A0 =C2=A0 vendor =C2=A0 =C2=A0 =3D 'Intel Corporation&#= 39;
=C2=A0 =C2=A0 device =C2=A0 =C2=A0 =3D 'CometLake-H GT2 [UH= D Graphics]'
=C2=A0 =C2=A0 class =C2=A0 =C2=A0 =C2=A0=3D display
=C2=A0 =C2=A0 subclass =C2=A0 =3D VGA

vgapci0@pci0:1:0:0: =C2=A0 =C2=A0 class=3D0x030000 re= v=3D0xa1 hdr=3D0x00 vendor=3D0x10de device=3D0x1f99 subvendor=3D0x17aa subdevice=3D0x3fa5
=C2=A0 =C2=A0 vendor =C2=A0 =C2=A0 =3D 'NVIDIA Corporation&= #39;
=C2=A0 =C2=A0 device =C2=A0 =C2=A0 =3D 'TU117M [GeForce GTX= 1650 Mobile / Max-Q]'
=C2=A0 =C2=A0 class =C2=A0 =C2=A0 =C2=A0=3D display
=C2=A0 =C2=A0 subclass =C2=A0 =3D VGA
###

/boot/loader.conf:
vmm_load=3D"YES"
pptdevs=3D"0/2/0"

etc/X11/xorg.conf.d/20-drivers.conf:
Section "Device"
=C2=A0=C2=A0=C2=A0 Identifier "Card0"
=C2=A0=C2=A0=C2=A0 Driver "nvidia"
=C2=A0=C2=A0=C2=A0 BusID =C2=A0"PCI:1:0:0"
EndSection

bhyve:
-s 6:0,passthru,0/2/0
(vm-bhyve vm config:
=C2=A0passthru0=3D"0/2/0")

I've already did this:=C2=A0
- ppt gets configured for intel
- xorg doesn't start with xorg "nvidia" config=
- xorg starts with scfb (with empty xorg config)
- start vm and crashes my laptop

I'm just looking for the correct setup to try it again when EDKII firmware gets updated/patched.

Thanks,
--
Nuno Teixeira
FreeBSD Committer (ports)

Hi Nuno!
If the laptops GPU setup is like "optimus" you will encount= er problems runing Xorg on your nvidia GPU.
I have a DELL 7720 with dedicated physical ports from the nvidia card to the display output(s), running Xorg on nvidia here but having the intel part _disabled_ in BIOS.
These mobile dual GPU setups aren't that easy like multiple PCIe cards in a desktop "PC"...

But maybe there is a solution for your laptop somewhere..

Regards,
Stephan



--
Nuno Teixeira
FreeBSD Committ= er (ports)
--00000000000010a810060d005b76--