From nobody Tue Jun 24 05:52:33 2025 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4bRDcf4g8Dz60L6J for ; Tue, 24 Jun 2025 05:52:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R10" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4bRDcf1gGDz3fST for ; Tue, 24 Jun 2025 05:52:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1750744354; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=DdU7zLKj3ME4VxlemceUWBLHxWjsQ+rXRbzfY14/IXw=; b=kmvoHs+TBgnVMFbPIbmmEbnGsvrNOiYgIoRirF1ET+98GAzHYKjANq4E3Nh0WPig4RZhRo O/DblaEFeJQah6WTikZMwpbo1NWKbLTnd7zKdPmA8jCQmHfLdEHMPNntpFoWyG4ScLGjI/ OgzGWt3bKC5aCQDBXmPGTz5ltLwZZ9C88gtrnxgq+AhBPmF+76q88Sa/fNKBx8Blic1U1/ oGcsUBQB4sFVzkFfXS7M9aA0AZ8utT9z0HhhqsFLtqs5AUIxZ1ENxJ28xK1AJCG9YU4Slw D94cqNEmDMH/ND8q+AMWN/pqloO2QTyfaJDRRAnTaHVYr07cpwetXg58m3DfIQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1750744354; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=DdU7zLKj3ME4VxlemceUWBLHxWjsQ+rXRbzfY14/IXw=; b=UNU0vVLokBHpbSUVWNAe08iSJ/igMrrswsKGmt221wsvblk1RV58Ik18/4/dD0+dQOlmiU aJ2C4vNWf6TkNT+2pG5GdDmB45wFWlv0mESSn+qEvZsnfeHjDX387/WE9q0RyMKRjj8+OP gTk1Lab27mRIIYh6pWo6XaOIJcYOLzwghQDQEv3zXpLYjIGFwjIKSvqC9bNAUQEXemznC9 dwV9tlc/G/DMbH/GxWI1yRi8U2lSHSimVhBe5YVe/qZO2tzLlsSEwfXdXHNj+Nj0Hasq2o sTTf0OL/XXSryvicmZDbCr7gVj9+f7pnLxE7WCIvQBlJP5W+Kl/9DIQOq+OtJw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1750744354; a=rsa-sha256; cv=none; b=Gf1S4A3oAkuujiGygcEPU5Ve3HJoDTKuN+2gqm+th0xcgpRENqcUUgFnpS7MasPmJPRiWh pR0nzjOY/TQG2J0KyK6K3tj2oSL5NScj3brQBBbbtkdnaE183X93yWDV5Jpbbhs9jmlh5R GpwyXZkrb1dl0ybIh1wl78wRr6wpZJwE9lm3Bn1CjMDx+9Wi0uIbxfjCjoeLU6id9vDUEp 54fVMoOOHqVaOFCWoUtmQgAoblBXMVTesMdQ/MN89euucIMCdbyQ2QNHXs5fNe2HeAnrIv p5wMgl57CS4KQYmtIOcIrjAvozUd4cCOZUgQW+PbVC7yQHKgwN5WdAPvonyZVQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4bRDcf10QtzbvG for ; Tue, 24 Jun 2025 05:52:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 55O5qY2f068777 for ; Tue, 24 Jun 2025 05:52:34 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 55O5qYZN068776 for virtualization@FreeBSD.org; Tue, 24 Jun 2025 05:52:34 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 236374] bhyve: vmm/amd: ivhd0: Error: completion failed Date: Tue, 24 Jun 2025 05:52:33 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: bsd@orsolic.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="UTF-8" X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D236374 Pero Or=C5=A1oli=C4=87 changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |bsd@orsolic.org --- Comment #1 from Pero Or=C5=A1oli=C4=87 --- I am also experiencing this issue. I have been using vm-bhyve and PCI passthru for several years now on AMD CP= U. I am forwarding multiple LAN, WLAN and USB PCI cards to the various VMs. FreeBSD 14.3-RELEASE, 1 day of uptime, several (less than 10 IIRC) restarts= of VM. After few restarts of VM these messages start to appear in the syslog on VM start: ivhd0: Error: completion failed tail:0x570, head:0x20. ivhd0: Dump last 1 command(s): [CMD0, off:0x10] opcode=3D 0x1 0x28c3eb1 0x0 0xa5a5 ivhd0: Error: completion failed tail:0x620, head:0x20. ivhd0: Dump last 1 command(s): [CMD0, off:0x10] opcode=3D 0x1 0x28c3eb1 0x0 0xa5a5 ivhd0: Error: completion failed tail:0x6d0, head:0x20. ivhd0: Dump last 1 command(s): [CMD0, off:0x10] opcode=3D 0x1 0x28c3eb1 0x0 0xa5a5 Inside Linux guest, when passed-through PCI USB card work: Bus 001 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub Bus 001 Device 002: ID 05e3:0610 Genesys Logic, Inc. Hub Bus 002 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub Bus 002 Device 002: ID 05e3:0626 Genesys Logic, Inc. Hub When it doesn't work: Bus 001 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub Bus 002 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub PCI passthru on other VMs is still working --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Jun 24 14:50:32 2025 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4bRSYR06NTz5ysdV for ; Tue, 24 Jun 2025 14:50:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R10" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4bRSYQ6Hqsz3N07 for ; Tue, 24 Jun 2025 14:50:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1750776634; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=pQtujmOUI1lo8tLrK/C8kBB0zwk/HV2oIjvpU7qcpXs=; b=B2yfLciZEJPD5hJRpbVlOVQF+5+dCzEIUU7Wk1ew5y/JG+4p8JfBpw17+RtuHuM0zcFlIk pYsZO5OiDvcdtMT+r8IxlYYgnK9AVV+dclrZFx8wjaYl9TYK0ylHP+uI/2Oh2RbbYLY8eM GqIPixsd+syt3e4Xu7d8fQzyaSpB43ICcGaLFxYy7SOBpTuLdAV8g66krDuhOBAwJeWe8n Jq5GO6rEEWRghx74TI2HJm5oTHlLVpmSxCjpCBtzVwjbV4UJNwgnEuyDwN+diMJEyRa3L9 7Aedb0LV7Fa1PL5wKuOeyczB7+pUrZZMtRMCAHm9ITgfoKEaRxkrZXMUdRTCgg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1750776634; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=pQtujmOUI1lo8tLrK/C8kBB0zwk/HV2oIjvpU7qcpXs=; b=eLRHGpDaFOPlRZ7wfK6RlmY/XgNuXnWsOv1jpo+mnNPh1EQ7mFkU3t0i1ZlvFMpTyHdAcB kAxU49aGje2heGXcldKrycGkh48SUvhyK2UqmA6LQna2eEucijZ7Du7EQ01aPVaqy9ZzO3 fiG0XSg4KTtGyYYAt72Whub2nAZ9skfiXfrdh0FkaV9LReVDiTFzoKmuqzmd0wj9qeF8EE EEIKAob2098w141yKSrGKtDLUCH6F1f83dElvXJIctjKMAuKXJSbzbxkwbjPWMiOZtLP6Z axZhim/MhxfT2H6DbD5XFKDvmDsZWIN5K2HG9UhIzL1VMpshc/Ybus6gUFWaUg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1750776634; a=rsa-sha256; cv=none; b=wV+gogdc2uwHn/9B3NuFV1sOwllbVxG7O1T2oebQLs6sd+hTfmz4y6XpaXGRXJeKhiUDNu 948ko0XZa1thFlBba3sa71Hnz8GIDylELo71Qvdk/yM+Q3Wa7+mrw4wv/2RRArVYM7OfiO T0VS9kPBks2vwa5BM+XJFP3mIwRKjF6mMQzuNUcHeoC2uQcQD1rntHj/2/1QSgAnK051qu TjlQWcSEP7irYAZizpF+k5J5VjsV8b8zi0IInf2xt+DRSQdAJv3KtqwiMQL9HG2ODQAlL6 2UXp71UNn8+jPHi8gxS5XDE6vlrRJiw/xAxp/7kqXGDMHRX3W69bLNTLGpxavA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4bRSYQ5t3szsf9 for ; Tue, 24 Jun 2025 14:50:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 55OEoYml064338 for ; Tue, 24 Jun 2025 14:50:34 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 55OEoYH7064337 for virtualization@FreeBSD.org; Tue, 24 Jun 2025 14:50:34 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 236374] bhyve: vmm/amd: ivhd0: Error: completion failed Date: Tue, 24 Jun 2025 14:50:32 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: bakul@iitbombay.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="UTF-8" X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D236374 Bakul Shah changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |bakul@iitbombay.org --- Comment #2 from Bakul Shah --- I face the same issue on a Ryzen system. There is no work around except to reboot the host. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Jun 26 13:07:34 2025 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4bSf9l1rw8z60Xyq for ; Thu, 26 Jun 2025 13:07:39 +0000 (UTC) (envelope-from corvink@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R11" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4bSf9k5MkBz3GqY for ; Thu, 26 Jun 2025 13:07:38 +0000 (UTC) (envelope-from corvink@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1750943258; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type:autocrypt:autocrypt; bh=JolHr336DWFX97eKkXrxOfylBDFcI/gMx3WNOLdvhUU=; b=FUyUTu0avGB47r+sybabXH6QZ6QV/YY7cKESUjPo4oHwm+8WSTPjp3C5TJ59TInfZcAjFj IH8KPTMYHNaHaBSWJ2EX1VGT04QEJfGpZ9n1TPJ+5AMQIpx5HRBfel39flbk2CNCBEMZzm qpRBGdhhtYbGW+djKJYtGucpJ+Tyx3gDZgjjGCQcNH8c+7NySmyKIoe0UIbkeVxl5AtEM7 3/F25KPPX/B422hRQsmdlJlf5xWASqctWuP5A8DEuw8AKu66oWv6rp+ctvrVXiWxiPrLhS 45z7fhHzS7Wv2EMb9r+cReFZ7EtHL1z0Gk+mrWE4S+UvwUla9arxtC1tegc0Hw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1750943258; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type:autocrypt:autocrypt; bh=JolHr336DWFX97eKkXrxOfylBDFcI/gMx3WNOLdvhUU=; b=xb2BotRvKex4/tWbOjgfnU1Xqz7Mb6qlNxK9Y32rUbtz4+6LFooMlD5wGfSng1s08bK54m qKgR7s07qL4zsN8KbdxCjHIBFOvGO8tNyGGL84Te+CKwVePHAOzzF+conhqCxAmi1fIuPY M2aAtVFE8dy77R7F84S2ET2KcT+XTFEyjQVJhh5iTYxrhTYTqAKHccGdmheKbb5wtDnkVZ RIwtlFmEtxvtaMTegiGZ5+grof/x+EP7nlLGtbp7qE4AACCGOixTN/o9SrVlP9PEDQxEj5 pRl3wAbZeMSTmWhUrEEaIjuL6IC4ll+B6LzPuIJUvDMvW+HIEbMcRHtQXvMPyw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1750943258; a=rsa-sha256; cv=none; b=e6tek2rHMCO4Ahr9r4bl6HD+Za7YG7l6WVVOeklS5SuBXZJSC6vXJjNb9nn0sEyF4fqpgF G/Wr8Dprk+WAId4dCobJg2GbyLHFXzGpTE99T4722qUFvAlLsNaRZ+eLGjng6Rv+KgzEtz GWBB7npaWWVE1Q2XtZzeXajsyuuR3b/GbGQ3XlIm3X6worwTsWmwXlb1HbIy6Vw2/sn9U4 P0cGwtYZ6OiikjuY+/sZEUbUULfich1pP8c+qdxUNqX43DPgLFYodhlIEvtoa9gjWWGADf B9kKD0ldOPTPUi49kXLW/8yjB2UbOFbGbdg0F7rwa7JLkBjoFJEsVDs0/LdJcQ== Received: from [IPv6:2001:9e8:dc2a:1700:d321:5276:2eef:c0b1] (unknown [IPv6:2001:9e8:dc2a:1700:d321:5276:2eef:c0b1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (prime256v1) server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: corvink) by smtp.freebsd.org (Postfix) with ESMTPSA id 4bSf9k3M4MzmlM for ; Thu, 26 Jun 2025 13:07:37 +0000 (UTC) (envelope-from corvink@FreeBSD.org) Message-ID: <4785074a005d66ed92e5670b9fa4ce45a5d65eba.camel@FreeBSD.org> Subject: bhyve: GPU passthrough for Nvidia cards From: Corvin =?ISO-8859-1?Q?K=F6hne?= To: freebsd-virtualization@freebsd.org Date: Thu, 26 Jun 2025 15:07:34 +0200 Autocrypt: addr=corvink@FreeBSD.org; prefer-encrypt=mutual; keydata=mQINBGNjZaIBEADDTrDNf+0pwiuRPBdClcnZW83dH1UhuOi0u+A1J2SatEBbNaFVtXXAa vewCTuyV/ZbNidjlhq3R/pWyiKjFKvs5dj7PMCw+3z2D5OWpMdHg7TrB+fbdFPOEsu0zQVKNaO+pS KCfN0Re0m7bL3wuvl7PXvBufRwA3Guo1P4j3TXWaEkuso7VupTvE25zVGg9ONHrGOjA9RUy+Yg4Se 3NLgtUdjBgA21SBQTDvRQV4fDmVenlwvWeE0Xm8FcDcpQb6sJTihaDku78mi3Ux1HCk7rTcepVEB0 xIB6qmFxv0sLlDmVv6Z6qg1y/Q5m23Pgz60o3TulMPV4F+3Itm8ifU+wgVSzBZbD29GYkd7LKqMkF bhvfSBk+5db3vbYY5OD//+LTM5AV7e2AhXuXMvG1UNBqXqSJTTSy6KZz+qmPQO0zos0dq46p8o82l KiBEGD2Hu0p+u0OyV+MmRYo1NIBFVbOPXp2MvUVl5II0UIJ3+N9gLBmfGA+HEpVO8PnvdoT/5NQ7m 8JK1rQHzjiDub/iDPAYMqKH4C0eZ/7zO0fuY5FeRNtuNtpH1Bw/+7/5RJH7bcKkfGHHEp15FJUrGH gWNydoDLB9QBprwQc8FEldDXBjzOMXIgh6FGKLNu6DswvIPGy6M3u7DXwDakCXz+c9Ym0oFihLzZx WntrsxdswD/CwARAQABtCdDb3J2aW4gS8O2aG5lIDxjb3J2aW4ua29laG5lQGdtYWlsLmNvbT6JAl QEEwEIAD4WIQSC9FKVreba38fZT0bYVNpWMV4CagUCZArUIwIbAwUJCWYBgAULCQgHAgYVCgkICwI EFgIDAQIeAQIXgAAKCRDYVNpWMV4CalcID/44k2i/mqSSi4W6FAobSF1nFLtP/pfcRNJriWKx2UF7 cfFMKyg7Nilg7FhLb5FDB1umUW2nFfchFPTUp4FfKzgRvPzIMg4RIRcVtTpYbl3z7zs9ZXD8qS//i ibbiUG3quncm6tO2x1jLZD3ORC+8MuLGXhYQIa4O5vVF2SBHdb/U6P+wsrF+U+OpRdEdQ/4Xu9S02 kltzBGgArjcexdhUqEqW01KCCSH0+qgfN1NE+9L934ZOB+cai2b9apPbCOGuV6KcUKMj4z0RWInhl XIyMqtmhdix/P/GjrQ1REVNdp74JeweSSedM15wwc6YLMXPrtOnnExyZ1gyNFYaub+Mdo3ZQ+8386 3B0C9IlpzEW0K8bYlZrl4WBNdcMOyByETAxgQmBgP6ZFErTtaeUOH1nX2FyR6o2GLSahRgngQmnRE zScTpPbBEkMwJMDAO+rbjjGxjeKSUwD1WOfbI6QZj+MS/uBk2p08kgN7fQaCEwj6jqML/IIE+FZ9I In6TNG0hChD384VHO+YioLBno1Atgi4Q7JUWSRIHQXZW+StQajFrWPPyKQwCe1MwqpKoMpX/q8IZB lzwJgZS8ShLeFZjtzOt1jgM99TD91Neonf9OzjTSbfo7sJviSWoICMhB/MvDZjj+naMVF86uGFxnI EsjVKyBxlJd4TRHnLYPTIHFKBLQjQ29ydmluIEvDtmhuZSA8Y29ydmlua0BGcmVlQlNELm9yZz6JA lQEEwEKAD4WIQSC9FKVreba38fZT0bYVNpWMV4CagUCY2NlogIbAwUJCWYBgAULCQgHAwUVCgkICw UWAwIBAAIeAQIXgAAKCRDYVNpWMV4CavfDEACCFnXpR7H9eOgP+GJMNPtK6i9/xnqdyXi8uCZIN0h YwjN4Xzo9SMLOf4UUlQEveOB+bGqbRfHd/fGKnrlXiPd0SGpKWJC21gqL/DsIH0J8I3Whth+O8tfP WeFy0oCsvBaaGFLIrDfoIgHF9i/gqEe48xhN42weB02Z3mdR1L0d7ME/BLwS0mCXe9Zh3uHw63S6x YB3Wsjptxe/ph6TpQDUKWtRJkjC6BqXPBdThpbbfIRWmjZbp2fKEJPvtRXS14+gbUqWeJ4xCvprA3 +ae7vtrp91X775yngyW3XTw5cmDiJIjykH8+zhEIoNQXNBpFrehkQDYrcM+WoE6NGSJo+3VJvSRWh UGWDVrxdTYNkbIjmTNlkI12NINC007DiuV7OF9XHWgrbbylvuZvbODmbJRdhTFy9upAUygX1/xUAQ EIMqMiJmyTdv8i0IbZ611WElQx9XHgGeZgM6+39/laN8FwspM6gE/4NzZHIZN0LEBOerZqoF+Il6e ccQpoEWx7nb/RilJp3dUUyvkBnJWg+AJByosg857kvvmDnZ3UB+bejWpcfFvnbkiKPUBPDO7tWPb5 r2yFDpDe/Vg5x+sRbkkXGUFD6Rx0p/ZiRIneVVg8emTzhDR0IL/BZkq/uVJkdaphZli1F/31cNgf6 ZJYnjxlk86uiYSySZQR0dKLDqq7QlQ29ydmluIEvDtmhuZSA8Yy5rb2VobmVAYmVja2hvZmYuY29t PokCVAQTAQgAPhYhBIL0UpWt5trfx9lPRthU2lYxXgJqBQJkCtScAhsDBQkJZgGABQsJCAcCBhUKC QgLAgQWAgMBAh4BAheAAAoJENhU2lYxXgJqI+QQAML5PTR7KpUFV3SLG60LQJGEOHUfDmJYczxBFb IAq1U4hIbivopu1AdLty7oDDrIjCVoa2/Cy34dd99O7lhLvUmZFB/zDSUtbUg2zhDkU0YSZ11Fdrl Wzky2tFaQRgxpDvWlUP0baa3Pd4dPDRiIUI6AOSR2SL6XANk6sJh56gLVM6G8yyafGsxSyDYg6Z78 EEMFejHwB+KP2DdsahupzM+F97HeC1+bOHYxtqN+2hEkPLtQWizyumPqNg5FvZhwe7yO8V95hF3Rh uDO+9aJT+WLLvcZEb/L1bI04IvZ5FWgCLI7Levd/DuOtZI8gWapHhqGZRbXB2fuJkCoKCl6V67h/7 aWhU3LjFTsC5siJyrxPjapKcIk8a7PqZDswNCKR+24LJ5D59mPgEOnsiCCVpik1WE/kgD+rOu9dQx jpjKwuKowf4EJP1KYNkYtoy1HthzyTOqPwqXC3IUl0GVPO3xw6MhUM3irCVFruC+ecVrv85Rd37vr duT6JvgW92xjWegMsamtkDZH8Ik/cmYhH0K/qEc6OZVNea/4PTEZe0uxODJ6pbMd80AJyGqDPPVeA gWJtEIG4k6IS8XyD5v1QJtlpDVpPwP/bbFnVc3h3Oatfn8Etm1KAqYvNwyO+om2PkF1p732uapDZd LwksVmgc9s79+9pSpeP5DbIeMzhrIK Content-Type: multipart/signed; micalg="pgp-sha512"; protocol="application/pgp-signature"; boundary="=-VENO5NF/pykVndgPG0ks" User-Agent: Evolution 3.56.2 List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 --=-VENO5NF/pykVndgPG0ks Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hi, I'm currently experimenting with GPU passthrough for Nvidia cards. All I ha= ve to do to make it work with Ubuntu guests, is setting the INTPIN register to an= y value instead of just 0x00. Unfortunately, I'm unfamiliar with PCI legacy interrupts and how they work. The INTLINE register is set to 0xFF (unconnec= ted). So, is it safe to set the INTPIN register or what has to be done for it to = work as expected? Any help would be appreciated. --=20 Kind regards, Corvin --=-VENO5NF/pykVndgPG0ks Content-Type: application/pgp-signature; name="signature.asc" Content-Description: This is a digitally signed message part -----BEGIN PGP SIGNATURE----- iQIzBAABCgAdFiEEgvRSla3m2t/H2U9G2FTaVjFeAmoFAmhdRhYACgkQ2FTaVjFe AmreXA/+MfZTTqB4tvJDjf4AJAyZzpRfgtX2qCAu4QkEBzbLpQCmO5gKIdqy2JXi S3LVHLRcCjFOvyuZHLjzwQ6x7JytOucwZSDetR/YWlw6WUNh6qiZr5O5nIGClwZg GP8I3BbtbaDXIIvZsHGZBoV4kOAtdyL5oXXtvZZk2zEufcJO93d6wM9v754M8V0v MSERARtEyfNSRAL+X16N/KuhkGjDncPtxH2g7+S2KeZMWJnZOWv7cSMmQPiomGLW sXocIOccHPk+TmfpPQRBrDcXUtObE8qpw/O4aF0DsI70hjq6VmCcOEaagfKkb6KP jb0aewbE7kH/d2O85T2nRq8JdIgtWCiRc2Q0SdK3vehiZLn1K2VX/idwSGm6eRgI ItkimGYJpXO3MyVS7/9svGXlxSVtAJ16mcO7s/h81hc628l7gGN2AjjStunyR7e4 4yX5XJGM8NVj86AOFiJbx+w1zJyMy/9Pc4FI4lF1Q0j0U3CFfV+77139Q2AvKbaT lAStzDAZbDOeaa+aA/gWG5qk/bPdfrlzIy6WZWHXN1obCo5eXgjBOxcaoUi8or8T AJfIrSvljbwZf5Hh3w0fv4KC/jc6jhJjp5/ecl+FYTphp0glWj9YO9iOBBIQL8zY 3fCJoXwm9b15jQfA8/50que00l9I2bjwcVheOuD4p5JJM7YnDjg= =krP2 -----END PGP SIGNATURE----- --=-VENO5NF/pykVndgPG0ks-- From nobody Thu Jun 26 14:49:51 2025 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4bShRp53nqz60dTY for ; Thu, 26 Jun 2025 14:49:58 +0000 (UTC) (envelope-from Stephan.Althaus@Duedinghausen.eu) Received: from mo4-p05-ob.smtp.rzone.de (mo4-p05-ob.smtp.rzone.de [85.215.255.134]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "*.smtp.rzone.de", Issuer "Telekom Security ServerID OV Class 2 CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4bShRm2WTQz4Gd3 for ; Thu, 26 Jun 2025 14:49:56 +0000 (UTC) (envelope-from Stephan.Althaus@Duedinghausen.eu) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=hoewweken.de header.s=strato-dkim-0002 header.b=bvXkonbf; dkim=pass header.d=hoewweken.de header.s=strato-dkim-0003 header.b=dDUKKHJ3; dkim=pass header.d=duedinghausen.eu header.s=default header.b=M4tAIoYQ; spf=none (mx1.freebsd.org: domain of Stephan.Althaus@Duedinghausen.eu has no SPF policy when checking 85.215.255.134) smtp.mailfrom=Stephan.Althaus@Duedinghausen.eu; dmarc=pass (policy=reject) header.from=duedinghausen.eu; arc=pass ("strato.com:s=strato-dkim-0002:i=1") ARC-Seal: i=1; a=rsa-sha256; t=1750949393; cv=none; d=strato.com; s=strato-dkim-0002; b=JPTLk+L44pVq7bZyHAlYZlV7dlhfdPnc3+A9p1XrQMFpb9iC9JKCaOOv26srihNYRD JtfoOV2wm14BsCjzXzOLra1Lw9rqlKSt2vv7yk6eBuvi86wN2VNGp6YVj8x+7u/Z8vlX OO1/ZL2ohI2oWnYsEXHCBJAd1Vjcuqy4mJZfZvVAPQbMeu/9bZyAMpMujvLqzPnVgcy4 nXxTCWFisD/OXPNhxdW5LSfdVktsptnqwTKVe7Hea/FzcCCAhRMq5qayrVe2UgTmD51t o+T1SFj3jTDwj0N5MF79tUl0xc+QgEYThI8ZKHVHyK+Yx/lP6mvG/RouDDPD6+yOgDkB Arjg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; t=1750949393; s=strato-dkim-0002; d=strato.com; h=In-Reply-To:From:References:To:Subject:Date:Message-ID:Cc:Date:From: Subject:Sender; bh=HVbJg165eLu4Sxn/MIJgSkMNkAOVjQhfI8I/nM2EJg4=; b=UrCxGHMoH/zh5pZlnjExROz88fOcHuVVBV8YEZI+PXn8aDR3LkVsHKfCW04T280Huc kL/Nr/Kgv2wQhssWNigM1XRK9Uih9W/yXmGVzfj0Ez5NQ6F5SFWeJ7zrqtbiH83UMwJV NqARZOev51Aq83YR12pWBaU+klv7PZoSY9Ap6Y3Lr3UM6aL0J4uGTylTUNfdQG9G3yM4 2FhjRaUMf67XXmeQFovF9P/QLRwoqmKZ1QbEmv1EaqDNNBnmUpZv6q1coP9IBxV/WY1C nv5umq/5gtijKq2OK++6GrjIsQjq2SD6YM4ByIsg+hHmVyR+US+CCEugoWTjG7vgwFWl XVmA== ARC-Authentication-Results: i=1; strato.com; arc=none; dkim=pass header.d="duedinghausen.eu" header.s="default" header.a="rsa-sha256" DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; t=1750949393; s=strato-dkim-0002; d=hoewweken.de; h=In-Reply-To:From:References:To:Subject:Date:Message-ID:Cc:Date:From: Subject:Sender; bh=HVbJg165eLu4Sxn/MIJgSkMNkAOVjQhfI8I/nM2EJg4=; b=bvXkonbfkhC5LEadFXow5cSPZt6HSq+vaiB6SKDG+Q1h55Y8StMY6iT/0G1Rkfjjkr eqIn7a62VEHDMO6ybI72t/Um9vGq6oxB9jqRwdKlY1mi7BX4gQ7HwksT+Jzhzae82wI3 KMKoFBK1Ce+JdCtqry4hU21HEPURvJea8MQ+jCt60UftQ+p2UigjxoP5hzIZnL2/FAw0 FftegGFsrrwDovojKGYOvPC4gWvu9qD2wJtyhVJmYvPY0sEDXk073fYapJISWvXdSVC+ Q/lTDIpCTmA14ejkgeSipHwiTfnby3+nLvyb0LqAYK90eSMDQvJWJ/L7n0Dy0zhw1wQO 6yCw== DKIM-Signature: v=1; a=ed25519-sha256; c=relaxed/relaxed; t=1750949393; s=strato-dkim-0003; d=hoewweken.de; h=In-Reply-To:From:References:To:Subject:Date:Message-ID:Cc:Date:From: Subject:Sender; bh=HVbJg165eLu4Sxn/MIJgSkMNkAOVjQhfI8I/nM2EJg4=; b=dDUKKHJ3KeZ9VLS5qm63vPdjMltL6LANZi1PxOmYLO6poEFcqkbsM4Afu4p9sX6w5X Io9iMPD07b7JzkNDy5Ag== X-RZG-AUTH: ":O2kGeEG7b/pS1EW2TmikjLDsYYueHLp2aWg0q38nsxvThUrH35SBqNi8UP9PRt5KqGVgfw==" X-RZG-CLASS-ID: mo05 Received: from www.duedinghausen.eu by smtp.strato.de (RZmta 51.3.0 DYNA|AUTH) with ESMTPSA id q88bdf15QEnr0oe (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256 bits)) (Client did not present a certificate) for ; Thu, 26 Jun 2025 16:49:53 +0200 (CEST) Received: from [192.168.2.63] (p4fea3d2f.dip0.t-ipconnect.de [79.234.61.47]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange x25519 server-signature ECDSA (secp384r1) server-digest SHA384) (No client certificate requested) (Authenticated sender: steven) by www.duedinghausen.eu (Postfix) with ESMTPSA id 2DF9C14F257 for ; Thu, 26 Jun 2025 16:49:53 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=duedinghausen.eu; s=default; t=1750949393; bh=vh4iIMvNYCbCHl52m8+eSRMptLHJdOl7A7UvPGbtP8Q=; h=Date:Subject:To:References:From:In-Reply-To; b=M4tAIoYQvFu4HCFb3fpH20LbRkmbWRYuB56CpsO0hp2V2+zdWWzmQqRC3pK0sxFmc DdWuaMzbEdEO8l5lOtnaJ0DmADwe+JpUW0fbvFPkxlR07R5HYSY3jS7w4Kmn5dkCfc OKOdcdq/uqa5FY7C7NLGJ5lSUSISxLV3KkKyTBndCazfn+4uK83ynsnLHSgI2cMC0J 0olV76ltR6qwZUDvQqZWNbWJhfrueGmkk7m4AhiTNlS56NAMD4msqighvhmfkJpfDG fN+lWiYJE6YmGRW0h76OD1D5YVYE0ffoWY0B7a9yOgi5VYDx/pMBl1+aNNZfwnASYM 1iMwuaZam4TGMEcRR5o9sUX+2/UWzKIvGLpR3EM8DtEcgh5unGHPjgpT+Lqr41ySO3 OwgjPvhfZz+O/3s0gfwytq1CHjhU239DUilhdqexomJL39MF8ruOahBSkPRKWnRnjb 3ZTDtIlgqlewYu4L45KDSkaeVN3ULPBK+Ee9KhpUapRWsJW+KLxNHvrDTX8LsD1RCZ HZ98dQA1eLJpCXcjzvhrSHXkkLkrlW0nXNY/0er4NULM42tO08CSRWj+Vl4WyisWwB H0l15MLTiD2tMfP7qKtv2LdpqNx4T6LUba1GlXifYd5Kk2eh3ODHKDjbASBwLASB9N oEZVuktDyS+BUnoiM+p5RvCc= Message-ID: Date: Thu, 26 Jun 2025 16:49:51 +0200 List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: bhyve: GPU passthrough for Nvidia cards To: virtualization@freebsd.org References: <4785074a005d66ed92e5670b9fa4ce45a5d65eba.camel@FreeBSD.org> Content-Language: en-US From: Stephan Althaus In-Reply-To: <4785074a005d66ed92e5670b9fa4ce45a5d65eba.camel@FreeBSD.org> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Spamd-Result: default: False [-4.35 / 15.00]; ARC_ALLOW(-1.00)[strato.com:s=strato-dkim-0002:i=1]; NEURAL_HAM_LONG(-0.99)[-0.992]; NEURAL_HAM_MEDIUM(-0.96)[-0.956]; NEURAL_HAM_SHORT(-0.61)[-0.606]; DMARC_POLICY_ALLOW(-0.50)[duedinghausen.eu,reject]; R_DKIM_ALLOW(-0.20)[hoewweken.de:s=strato-dkim-0002,hoewweken.de:s=strato-dkim-0003,duedinghausen.eu:s=default]; MIME_GOOD(-0.10)[text/plain]; RCPT_COUNT_ONE(0.00)[1]; ASN(0.00)[asn:6724, ipnet:85.215.255.0/24, country:DE]; RCVD_VIA_SMTP_AUTH(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_ALL(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; MLMMJ_DEST(0.00)[virtualization@freebsd.org]; R_SPF_NA(0.00)[no SPF record]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[85.215.255.134:from]; RCVD_COUNT_TWO(0.00)[2]; TO_MATCH_ENVRCPT_ALL(0.00)[]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[virtualization@freebsd.org]; DKIM_TRACE(0.00)[hoewweken.de:+,duedinghausen.eu:+] X-Rspamd-Queue-Id: 4bShRm2WTQz4Gd3 X-Spamd-Bar: ---- On 6/26/25 15:07, Corvin Köhne wrote: > Hi, > > I'm currently experimenting with GPU passthrough for Nvidia cards. All I have to > do to make it work with Ubuntu guests, is setting the INTPIN register to any > value instead of just 0x00. Unfortunately, I'm unfamiliar with PCI legacy > interrupts and how they work. The INTLINE register is set to 0xFF (unconnected). > So, is it safe to set the INTPIN register or what has to be done for it to work > as expected? > > Any help would be appreciated. > > Hi! You surely mean 'newer' NVidia cards, as my GT1030 works with FreeBSD 14.2 Host and ubuntu guest, NVIdia driver 570, (and Win guest btw) out-of-the-box, no kernel/driver modding... Regards, Stephan From nobody Thu Jun 26 21:47:36 2025 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4bSsjw336Nz5yqV7 for ; Thu, 26 Jun 2025 21:47:48 +0000 (UTC) (envelope-from eduardo@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R11" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4bSsjw0rVRz48XH for ; Thu, 26 Jun 2025 21:47:48 +0000 (UTC) (envelope-from eduardo@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1750974468; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=y9FRlTF6apXkx0RijOayCRCD2xB93RBnuomOPOqyXYA=; b=GRKBO7/dvXjSfuoThVGwlT1Tr2bTgRW11k+tbu3YQ4tmKwLAuJ3SPqIlMuBRiHHzhFpLf/ ixPOZ9gNxP6kD3CUgsusIX7l9OV4aUUtTkDswkzACQJL+OFYF6JuIDu6r30d0T2nzg3Gnf 3L+NFqCSQAD/IReZW553zf0ZiPxoE4fD4HohG5bJLk3Qd45pWSX6YwTL+Q28DJLIfTTYP8 9vc9Qpp6yb7nDCHE7z0Eb6W7SyE5jpQfMGJa3Is98bWXjXG0v5IWjdZEVDGmNxZpaMpq1a XjBJ0H2WRNJNerwmuxrSw9CtgdjLoEe3/YfWuxrVba3j4JapcEYdoEDKHg1Vqw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1750974468; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=y9FRlTF6apXkx0RijOayCRCD2xB93RBnuomOPOqyXYA=; b=DSKloV6uy6GpKZdBr2XAwpvA6eVtl0qS+67yRhUXi59R8RGPtXxIinn8Qzv5YXHwiyZXRM jGEWEf/XP3tk5rCsDr/2VcGPclPzqSuCDHXXvjQJtvQ5N4uinKZUlZl5H//XuZ2f/hjIT/ qBqEPcJLxul8s3ZaYfm0NTu1iK88Rszj4BUisT1uruPKCl7HBqSoeJnVVgmNzoNv2sHlCN Y/1YB2jaC1fnKYrb56Yy7RMJjbghhBWphrnjSQx2WBVttda0tfpddqSCWsA8hXP3yesI+J FCVoiTBR/7Bq1Qq538n8htMhHio7jZr77r/WD3qNBYcbx0yK+EEL3Dl5w/sd/w== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1750974468; a=rsa-sha256; cv=none; b=RsBmXMa4bld3R9zi+vBJjP3sbFIb0AvFbpfI+TzFCIn7I9OWd0VeLtlfCnpNtQee+DMAGf Tdz42n20fL1UJHmBNFeAPivVwTEaa1a6TiXqZKqpDf5Chs01w9zLOALh5FPPY45mbrHyH3 ptXAjYrCXUkd1BJH2mlLx5XDRcHb7oMOsrHb/B4JzCIIAwQUxQwYElvU1LuAK5Pva3gJpP dCJP+XCw9Wu3KyzGVs7Zytvd5AYzIrU7i5g4g+ttrm+b6UGuh9u4LhN/XdTw/Uxsj7zY76 D+hyXPD15rAwk1wyHzqC6GX8WQ4E1FpmDOSkiGKBLMk+/oBKpWWlBOJV/ipX9g== Received: from mail-qt1-f180.google.com (mail-qt1-f180.google.com [209.85.160.180]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) (Authenticated sender: eduardo) by smtp.freebsd.org (Postfix) with ESMTPSA id 4bSsjv6mJbzyPb for ; Thu, 26 Jun 2025 21:47:47 +0000 (UTC) (envelope-from eduardo@freebsd.org) Received: by mail-qt1-f180.google.com with SMTP id d75a77b69052e-4a43e5c2b1aso2479211cf.2 for ; Thu, 26 Jun 2025 14:47:47 -0700 (PDT) X-Gm-Message-State: AOJu0YwtGPbdGX/cGr/GPHL6YYewf74gPlnEH1+/lqeJyVoDbUGEYL00 +SWLnOiOlKs/y7Hc+b6Cz7fCG7KkQmITIQKGorrleIsqDiEj2jrOxa9eUUswbaNc9m9+rg+xhVe 4MO6icpm6I51UDfeKPtdGLqyX6ucS15Y= X-Google-Smtp-Source: AGHT+IF1G9LG+5ansttOrvYMmjzVgdGQvIxyOlLpe8dvD5HHD95MP0RyeGacQ/ehQvyFBlS1g4ffiCu/MYXPG24osV0= X-Received: by 2002:ac8:5f4d:0:b0:4a7:4eed:2582 with SMTP id d75a77b69052e-4a7fcc3b09fmr7875971cf.4.1750974467405; Thu, 26 Jun 2025 14:47:47 -0700 (PDT) List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 References: <4785074a005d66ed92e5670b9fa4ce45a5d65eba.camel@FreeBSD.org> In-Reply-To: From: Nuno Teixeira Date: Thu, 26 Jun 2025 22:47:36 +0100 X-Gmail-Original-Message-ID: X-Gm-Features: Ac12FXynOK6EMbZJglfnoGhaE6uUQFSPeyGx_GihE6zbXJtSvB_4IEjqkWgYPuU Message-ID: Subject: Re: bhyve: GPU passthrough for Nvidia cards To: Stephan Althaus Cc: virtualization@freebsd.org Content-Type: multipart/alternative; boundary="00000000000023ff3406388083b2" --00000000000023ff3406388083b2 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hello Stephan, A year a go I did try passtrhu a dedicated nvidia GTX 1650 while using integrated intel graphics (laptop Lenovo Legion 5 15IMH05). Windows detected card but nvidia drivers install failed at some point. On this laptop I did setup bios to use integrated graphics so I can passthru dedicated nvidia. Think I will give a new try since I follow main. Are you using laptops for this usecase? Thanks! Stephan Althaus escreveu (quinta, 26/06/2025 =C3=A0(s) 15:50): > On 6/26/25 15:07, Corvin K=C3=B6hne wrote: > > Hi, > > > > I'm currently experimenting with GPU passthrough for Nvidia cards. All = I > have to > > do to make it work with Ubuntu guests, is setting the INTPIN register t= o > any > > value instead of just 0x00. Unfortunately, I'm unfamiliar with PCI lega= cy > > interrupts and how they work. The INTLINE register is set to 0xFF > (unconnected). > > So, is it safe to set the INTPIN register or what has to be done for it > to work > > as expected? > > > > Any help would be appreciated. > > > > > Hi! > > You surely mean 'newer' NVidia cards, as my GT1030 works with FreeBSD > 14.2 Host and ubuntu guest, NVIdia driver 570, (and Win guest btw) > out-of-the-box, no kernel/driver modding... > > Regards, > > Stephan > > > > --=20 Nuno Teixeira FreeBSD UNIX: Web: https://FreeBSD.org --00000000000023ff3406388083b2 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hello Stephan,

A yea= r a go I did try passtrhu a dedicated nvidia GTX 1650 while using integrate= d intel graphics (laptop Lenovo Legion 5 15IMH05). Windows detected card bu= t nvidia drivers install failed at some point.
On this laptop I di= d setup bios to use integrated graphics so I can passthru dedicated nvidia.=

Think I will give a new try since I follow main.

Are you using laptops for this usecase?

Thanks!

Stephan Althaus <Stephan.Althaus@duedinghausen.eu> escreveu (quinta, 26/06/2025 = =C3=A0(s) 15:50):

--
Nuno Teixeira
=
FreeBSD UNIX:=C2=A0 <eduardo@FreeBSD.org>=C2=A0 =C2=A0Web:=C2=A0 https://Fr= eeBSD.org
--00000000000023ff3406388083b2-- From nobody Thu Jun 26 23:33:41 2025 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4bSw4B1jCkz5yx4M for ; Thu, 26 Jun 2025 23:33:46 +0000 (UTC) (envelope-from rcocker87@gmail.com) Received: from mail-il1-x134.google.com (mail-il1-x134.google.com [IPv6:2607:f8b0:4864:20::134]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4bSw496jDsz3PYK; Thu, 26 Jun 2025 23:33:45 +0000 (UTC) (envelope-from rcocker87@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-il1-x134.google.com with SMTP id e9e14a558f8ab-3df2ccbb895so11358965ab.3; Thu, 26 Jun 2025 16:33:45 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1750980823; x=1751585623; darn=freebsd.org; h=mime-version:content-language:accept-language:in-reply-to :references:message-id:date:thread-index:thread-topic:subject:cc:to :from:from:to:cc:subject:date:message-id:reply-to; bh=aXif1b6JifqgTkaJDpPrPotF2rJufp3xW3JMou5Z+Qk=; b=O6rpWkj/o3ledqj7IwWO3ttI1IAyl3FkDyP7qs2Ib2VMMhnG1nywKYgZpBRXSMyUaY 5nDJgUtEZs5s7eVHIal7oTbX8ucIfgtTC4sKxxhl0sBq38b7OtCcFhHoHbjwMEC60kg0 xGttYTy7f7dUqcUPUbL9uKW1aWjv/KTGNT1X60COSOnjw4iCaBlTerAHQus0foyoPUWI AnlPZWLgqUKVOjpEX7ngZbHOV0z2PQI+66dN7JcZMXU9Yuc9MEsehn418A99Nl1Skxjs KuOw0KKImDHaULDM3r3akU5NkttqoRH93RRD5fWGINTGUdce2VCbO1GAzk1/LeksMHVp sJsQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1750980823; x=1751585623; h=mime-version:content-language:accept-language:in-reply-to :references:message-id:date:thread-index:thread-topic:subject:cc:to :from:x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=aXif1b6JifqgTkaJDpPrPotF2rJufp3xW3JMou5Z+Qk=; b=GZgmyjKnlhEFNNFTNnS8KC8BiYm4NlTPQbereU+LQxUCywXke6qXp2lXA3ubPiCuwS ppWdXhFHSpE3hloBUxPQl1+V2xhrg7W0x+mZQ30CG0UlEmW+kBXmCf/pmkeNaFo1wHx0 GUep9ntZ2cGtXHtqUw0VpHggUQo4RK+mrf6/PVO5F749YAC146gVq5KsULlj0+Y8jimO WCONrixCn1904jRMrhdfnaehjmx23nBDj6YzDU/RA0qGbWT8SJam+D33j6ss6mQ8E3Ca gtHGEJswiFCfEPOAHnjyIzDyaiM1mvWqercj2iDKGSlmbPfnK3iwLp7/2/y7pZsXgOSk GcpA== X-Gm-Message-State: AOJu0Yz5kEwvj+GG4v5Nu4gey9YUKgavvdUfGp5IlCqS1RptgOIk1KVY dqgqhSHXsQgIPx0BcedgbMrKuaM+bklf63vTBE3tl3EcMMX3wd9awMK7vZE+0zER X-Gm-Gg: ASbGncuEG7j0TuuASfmeUFvBeIN7UP8PNa/4pJUJNiRAqRxCEzQQjvTE8YzxdJVdoDR GZPW3mccFa/zFp67JQX0b81pS4bSS/s/ad8rv/Zywg0pDOTtyhXrN0IxPmnuS5nUgLmFEW7ZHXo T9u7jJMRZ/zvZVRMF8Pt+U8PnYRzvsS1JtBvLfPuJ5BZLoRmcXYZ6GxJUPYmZOAGgMceCMk960e 2hQ8/rlBI6X7XPjelj6aGwvhJp9DKll2jSHmnfrT64PnXQdIwx5UisENe+i4VCBT7RJHb4j7eGP jN0Ovt/mJSG4TEaJ4dV3EThfYAT9ppJBZxtOTXeCWRWanHfZ4YBn3vuvCUnGoSSpmd5x3YMaFxz amugbuR4uymgS7GlrRTykoX00mozLoPH639WN+jUz80rEWmWZxP4= X-Google-Smtp-Source: AGHT+IGIHu2fOPegPvz3I+nCvyUnghQzEc2bOyZmlr5jtj1j+155KW9NJ2NdF4+yxmUhT3PxEAMN8w== X-Received: by 2002:a05:6e02:318f:b0:3dd:cacb:b88d with SMTP id e9e14a558f8ab-3df4ab8469amr17872485ab.14.1750980823066; Thu, 26 Jun 2025 16:33:43 -0700 (PDT) Received: from MN2PR20MB3168.namprd20.prod.outlook.com ([2603:1036:302:40c1::5]) by smtp.gmail.com with ESMTPSA id e9e14a558f8ab-3df49fd566dsm2708595ab.1.2025.06.26.16.33.42 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 26 Jun 2025 16:33:42 -0700 (PDT) From: Robert Cocker To: Nuno Teixeira , Stephan Althaus CC: "virtualization@freebsd.org" Subject: Re: bhyve: GPU passthrough for Nvidia cards Thread-Topic: bhyve: GPU passthrough for Nvidia cards Thread-Index: AWw1NGUwNXUheFQ2uQax0hKrn7q3HTg3MDQxZ3hGU27aZgB13w== X-MS-Exchange-MessageSentRepresentingType: 1 Date: Thu, 26 Jun 2025 23:33:41 +0000 Message-ID: References: <4785074a005d66ed92e5670b9fa4ce45a5d65eba.camel@FreeBSD.org> In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-Exchange-Organization-SCL: -1 X-MS-TNEF-Correlator: X-MS-Exchange-Organization-RecordReviewCfmType: 0 x-ms-reactions: allow Content-Type: multipart/alternative; boundary="_000_MN2PR20MB31681D1566D16CA5E9DA7B5DFE7AAMN2PR20MB3168namp_" List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 X-Rspamd-Queue-Id: 4bSw496jDsz3PYK X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] --_000_MN2PR20MB31681D1566D16CA5E9DA7B5DFE7AAMN2PR20MB3168namp_ Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Hey group, I am also interested in this space of base system. Has anyone pulled the do= cumentation for what is currently available for GPU drivers for base system Robert ________________________________ From: owner-freebsd-virtualization@FreeBSD.org on behalf of Nuno Teixeira Sent: Thursday, June 26, 2025 4:47:36 PM To: Stephan Althaus Cc: virtualization@freebsd.org Subject: Re: bhyve: GPU passthrough for Nvidia cards Hello Stephan, A year a go I did try passtrhu a dedicated nvidia GTX 1650 while using inte= grated intel graphics (laptop Lenovo Legion 5 15IMH05). Windows detected ca= rd but nvidia drivers install failed at some point. On this laptop I did setup bios to use integrated graphics so I can passthr= u dedicated nvidia. Think I will give a new try since I follow main. Are you using laptops for this usecase? Thanks! Stephan Althaus > escreveu (quinta, 26/06/2025 =E0(s) 15:50): On 6/26/25 15:07, Corvin K=F6hne wrote: > Hi, > > I'm currently experimenting with GPU passthrough for Nvidia cards. All I = have to > do to make it work with Ubuntu guests, is setting the INTPIN register to = any > value instead of just 0x00. Unfortunately, I'm unfamiliar with PCI legacy > interrupts and how they work. The INTLINE register is set to 0xFF (unconn= ected). > So, is it safe to set the INTPIN register or what has to be done for it t= o work > as expected? > > Any help would be appreciated. > > Hi! You surely mean 'newer' NVidia cards, as my GT1030 works with FreeBSD 14.2 Host and ubuntu guest, NVIdia driver 570, (and Win guest btw) out-of-the-box, no kernel/driver modding... Regards, Stephan -- Nuno Teixeira FreeBSD UNIX: Web: https://FreeBSD.org --_000_MN2PR20MB31681D1566D16CA5E9DA7B5DFE7AAMN2PR20MB3168namp_ Content-Type: text/html; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable
Hey group,

I am also interested in this space of base system. Has anyone pulled the do= cumentation for what is currently available for GPU drivers for base system=  

Robert
From: owner-freebsd-virtual= ization@FreeBSD.org <owner-freebsd-virtualization@FreeBSD.org> on beh= alf of Nuno Teixeira <eduardo@freebsd.org>
Sent: Thursday, June 26, 2025 4:47:36 PM
To: Stephan Althaus <Stephan.Althaus@duedinghausen.eu>
Cc: virtualization@freebsd.org <virtualization@freebsd.org> Subject: Re: bhyve: GPU passthrough for Nvidia cards
 
Hello Stephan,

A year a go I did try passtrhu a dedicated nvidia GTX 1650 while using inte= grated intel graphics (laptop Lenovo Legion 5 15IMH05). Windows detected ca= rd but nvidia drivers install failed at some point.
On this laptop I did setup bios to use integrated graphics so I can passthr= u dedicated nvidia.

Think I will give a new try since I follow main.

Are you using laptops for this usecase?

Thanks!

Stephan Althaus <Stephan.Althaus@duedinghausen.eu&g= t; escreveu (quinta, 26/06/2025 =E0(s) 15:50):
On 6/26/25 15:07, Corvin K=F6hne wrote:
> Hi,
>
> I'm currently experimenting with GPU passthrough for Nvidia cards. All= I have to
> do to make it work with Ubuntu guests, is setting the INTPIN register = to any
> value instead of just 0x00. Unfortunately, I'm unfamiliar with PCI leg= acy
> interrupts and how they work. The INTLINE register is set to 0xFF (unc= onnected).
> So, is it safe to set the INTPIN register or what has to be done for i= t to work
> as expected?
>
> Any help would be appreciated.
>
>
Hi!

You surely mean 'newer' NVidia cards, as my GT1030 works with FreeBSD
14.2 Host and ubuntu guest, NVIdia driver 570, (and Win guest btw)
out-of-the-box, no kernel/driver modding...

Regards,

Stephan





--
Nuno Teixeira
FreeBSD UNIX:  <eduardo@FreeBSD.org>= ;   Web:  https://FreeBSD.org
--_000_MN2PR20MB31681D1566D16CA5E9DA7B5DFE7AAMN2PR20MB3168namp_-- From nobody Fri Jun 27 06:00:31 2025 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4bT4fY5lJTz60Ky2 for ; Fri, 27 Jun 2025 06:00:37 +0000 (UTC) (envelope-from Stephan.Althaus@Duedinghausen.eu) Received: from mo4-p05-ob.smtp.rzone.de (mo4-p05-ob.smtp.rzone.de [85.215.255.134]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "*.smtp.rzone.de", Issuer "Telekom Security ServerID OV Class 2 CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4bT4fW6JThz3MJT for ; Fri, 27 Jun 2025 06:00:35 +0000 (UTC) (envelope-from Stephan.Althaus@Duedinghausen.eu) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=hoewweken.de header.s=strato-dkim-0002 header.b=jEhOPKx+; dkim=pass header.d=hoewweken.de header.s=strato-dkim-0003 header.b=oqpPEmNj; dkim=pass header.d=duedinghausen.eu header.s=default header.b=ZS21Onj8; spf=none (mx1.freebsd.org: domain of Stephan.Althaus@Duedinghausen.eu has no SPF policy when checking 85.215.255.134) smtp.mailfrom=Stephan.Althaus@Duedinghausen.eu; dmarc=pass (policy=reject) header.from=duedinghausen.eu; arc=pass ("strato.com:s=strato-dkim-0002:i=1") ARC-Seal: i=1; a=rsa-sha256; t=1751004032; cv=none; d=strato.com; s=strato-dkim-0002; b=m6YNwQUce9iNQe4kyaVdZOFAKIbUdlEwrFKZzfsBEuUuqcR3AkGYBmT17SmjDNCPjm kRBq8gTEHZg7Y2uAU3DKMc3WFlJQQZl0uwGhG1n7+RkyWO13go4oWIDvPdRoV68DegzN LQHvkVRxAlZBJj3WUKuq6PBRY07K+WjdWNyAH8dvTAGWR147342+zKBlZTH1QOvAnTDx S2LkBTpqA95XTFSymXOTNeMbpXjG++3fJ0AtdKJYyXuV+NGjHW5F/bFQHR68cuowoEFv yfVuIuyqwbBIQMOFJkpseHFkcwfbiFW6js4myVHxw4TANJi9QU4QdyKUdBGFOZMKLuv7 wZMg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; t=1751004032; s=strato-dkim-0002; d=strato.com; h=In-Reply-To:From:References:To:Subject:Date:Message-ID:Cc:Date:From: Subject:Sender; bh=8TLJSTjhNsKkwEgiI3xALs/cjvyagZrSNcnG3x9F0zI=; b=VawXs3wN54ZIhiozJjUbizX5Enmdj14YjvdxQRsXar19eR8pJ3ueRs6Hp/9LL+Y0Yl tn90SuRF1Jjt3OJ38yS4113Z8kQDONmSIJDo9NE5tiiU/ZeeJkE5UOf01u03c/BfLoFN 6122y54EEVY4E/U8FzivEcJbSzLT+lyjW+Zzk1o3TiPiyn4657KuqOctkBoEbPMcijIQ iJsISQlBm6Al0TPdTasSJ5pWRT/e/8q2r14ResSbP9JgpOZZmc7VGtAqTe3/g6TSRTNc m0ldsYaAjZYDvLyuPjT3My+wnuzvnD2iqyI7J56lZBYbIy4FP6fl6i60tuvkxgQuTjnt x9lA== ARC-Authentication-Results: i=1; strato.com; arc=none; dkim=pass header.d="duedinghausen.eu" header.s="default" header.a="rsa-sha256" DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; t=1751004032; s=strato-dkim-0002; d=hoewweken.de; h=In-Reply-To:From:References:To:Subject:Date:Message-ID:Cc:Date:From: Subject:Sender; bh=8TLJSTjhNsKkwEgiI3xALs/cjvyagZrSNcnG3x9F0zI=; b=jEhOPKx+Mo+5jWm+imMbmi43xeN/4fvi3BISpgAt+8sm0WrCA6VtxGwG51SueutW8J X/19aJ0o7Vd4mbGdVYbZNaKMWPl27+NCpbil49+7S/wXY2eBLl7LdO4y1TQWsCkUfFk6 tdo9f6mMGJboVmm30+EPaCQHQZzofHeTqA3YryF7gyVrKQBslpAJ3n49bFfCOdv2l8kb w6Xe7z+xgn0UKJSwYx3du1mwMiYxQTmLJ+sbmMuoBvktuH87b3nlsA3jiOhD9fb3vvoi 1nzp9QmARqdHS9GFoRfGWnXdIibcDXzjZ5ZE2GDeFCKGKJB9LbEz5hPorHVMIxSk7mb9 mx8g== DKIM-Signature: v=1; a=ed25519-sha256; c=relaxed/relaxed; t=1751004032; s=strato-dkim-0003; d=hoewweken.de; h=In-Reply-To:From:References:To:Subject:Date:Message-ID:Cc:Date:From: Subject:Sender; bh=8TLJSTjhNsKkwEgiI3xALs/cjvyagZrSNcnG3x9F0zI=; b=oqpPEmNjtIXUMbpF9DgNASTtO6vj28t2EZPVOXU8LGLAjNJ11+/M2I5XIqmWSBtmu3 +0YgyaUKGsAzHPfNf+Aw== X-RZG-AUTH: ":O2kGeEG7b/pS1EW2TmikjLDsYYueHLp2aWg0q38nsxvThUrH35SBqNi8UP9PRt5KqGVgfw==" X-RZG-CLASS-ID: mo05 Received: from www.duedinghausen.eu by smtp.strato.de (RZmta 51.3.0 DYNA|AUTH) with ESMTPSA id q88bdf15R60W2Iu (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256 bits)) (Client did not present a certificate) for ; Fri, 27 Jun 2025 08:00:32 +0200 (CEST) Received: from [192.168.2.63] (p4fea3d2f.dip0.t-ipconnect.de [79.234.61.47]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange x25519 server-signature ECDSA (secp384r1) server-digest SHA384) (No client certificate requested) (Authenticated sender: steven) by www.duedinghausen.eu (Postfix) with ESMTPSA id 11D4714F4BB for ; Fri, 27 Jun 2025 08:00:31 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=duedinghausen.eu; s=default; t=1751004032; bh=zmEEu2shkJWoKhYn9HYhNBjLuFXYjX+puAbb2iphofo=; h=Date:Subject:To:References:From:In-Reply-To; b=ZS21Onj88WReOdTmGiPSyZZVEGJN78otKuIhS8RfPVoEV/dQAnyiRzPxoQAymv2w+ 4qhsI85HWJRIq/gp2BDmeMoLBbW6ff8P6qXSxwbGV0qdeEXWTYKmPfW1I8tMj3h+x2 QB8PBCO5kNgAvqBcSb1ZnuLHyc23rDBQR+GQ1/1aXo8jfPUQ1Va1c/u9OLGECV0PfH VwoYhQ5Atl8i2sOl5jVkcEi25thQF4Ok8+9dHCK68jwPDZM2GK+pbT5+Syy2HbN2ZY 9X0V9zrkicyTo/PR822W2aGlnEHTIjd3MXd5LKGwjFLE6Q1WGGJi3lIUHeYSYnE/MK xAylYzjLmxYrHAT4OGi6tO84S1rmjrdyFO5fcIb2Xh5tgysqz2jKlsjwJmXBJwJBTi sIwvzdzkWpoRagtLPnzuqdelTwSXGdsN3IR8XUtGcz2lGOcPl3vkkQ1GgFmzzzTQnr QbkraP4rZvKh3fFpH2MZEbtxFfzFVVsl/o3soNZc4z/1axCSirNdd68eiFrw7k/0HM Z1SJAzBFkN1UTXu0vlZXENRsc22+DVvT+W4ymU8jyC78pvwEsVPRIbsG8m4//VG7+F uUidcmMiGSUDSmTzG2f3CawihLd3QwDDZ4cbfUW9pUyM/ccR8icxntpfBgYKmqJAA0 7//CFqDXdbZOV6v5/0HSL9Yc= Content-Type: multipart/alternative; boundary="------------NcnU6sHKEteXYou2EhH0MPcW" Message-ID: <89c5f73c-4b7a-4669-a1cf-d2837c096298@Duedinghausen.eu> Date: Fri, 27 Jun 2025 08:00:31 +0200 List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: bhyve: GPU passthrough for Nvidia cards To: virtualization@freebsd.org References: <4785074a005d66ed92e5670b9fa4ce45a5d65eba.camel@FreeBSD.org> Content-Language: en-US From: Stephan Althaus In-Reply-To: Content-Transfer-Encoding: 8bit X-Spamd-Result: default: False [0.15 / 15.00]; URI_COUNT_ODD(1.00)[9]; ARC_ALLOW(-1.00)[strato.com:s=strato-dkim-0002:i=1]; NEURAL_SPAM_MEDIUM(0.94)[0.945]; NEURAL_SPAM_LONG(0.93)[0.934]; NEURAL_HAM_SHORT(-0.93)[-0.933]; DMARC_POLICY_ALLOW(-0.50)[duedinghausen.eu,reject]; R_DKIM_ALLOW(-0.20)[hoewweken.de:s=strato-dkim-0002,hoewweken.de:s=strato-dkim-0003,duedinghausen.eu:s=default]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; RCVD_VIA_SMTP_AUTH(0.00)[]; ASN(0.00)[asn:6724, ipnet:85.215.255.0/24, country:DE]; RCPT_COUNT_ONE(0.00)[1]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_TLS_ALL(0.00)[]; MLMMJ_DEST(0.00)[virtualization@freebsd.org]; RCVD_IN_DNSWL_NONE(0.00)[85.215.255.134:from]; R_SPF_NA(0.00)[no SPF record]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; TO_MATCH_ENVRCPT_ALL(0.00)[]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[virtualization@freebsd.org]; DKIM_TRACE(0.00)[hoewweken.de:+,duedinghausen.eu:+] X-Rspamd-Queue-Id: 4bT4fW6JThz3MJT X-Spamd-Bar: / This is a multi-part message in MIME format. --------------NcnU6sHKEteXYou2EhH0MPcW Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit On 6/26/25 23:47, Nuno Teixeira wrote: > Hello Stephan, > > A year a go I did try passtrhu a dedicated nvidia GTX 1650 while using > integrated intel graphics (laptop Lenovo Legion 5 15IMH05). Windows > detected card but nvidia drivers install failed at some point. > On this laptop I did setup bios to use integrated graphics so I can > passthru dedicated nvidia. > > Think I will give a new try since I follow main. > > Are you using laptops for this usecase? > > Thanks! > > Stephan Althaus escreveu (quinta, > 26/06/2025 à(s) 15:50): > > On 6/26/25 15:07, Corvin Köhne wrote: > > Hi, > > > > I'm currently experimenting with GPU passthrough for Nvidia > cards. All I have to > > do to make it work with Ubuntu guests, is setting the INTPIN > register to any > > value instead of just 0x00. Unfortunately, I'm unfamiliar with > PCI legacy > > interrupts and how they work. The INTLINE register is set to > 0xFF (unconnected). > > So, is it safe to set the INTPIN register or what has to be done > for it to work > > as expected? > > > > Any help would be appreciated. > > > > > Hi! > > You surely mean 'newer' NVidia cards, as my GT1030 works with FreeBSD > 14.2 Host and ubuntu guest, NVIdia driver 570, (and Win guest btw) > out-of-the-box, no kernel/driver modding... > > Regards, > > Stephan > > > > > > -- > Nuno Teixeira > FreeBSD UNIX:    Web: https://FreeBSD.org > Hello! Oh, laptops... With this "Optimus"-called feature i am not shure if it will work... But i think it's worth trying. Maybe you will need the GPU ROM. (https://forums.FreeBSD.org/threads/current-state-of-bhyve-nvidia-passthrough.88244/post-706455) Good luck! Stephan --------------NcnU6sHKEteXYou2EhH0MPcW Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: 8bit
On 6/26/25 23:47, Nuno Teixeira wrote:
Hello Stephan,

A year a go I did try passtrhu a dedicated nvidia GTX 1650 while using integrated intel graphics (laptop Lenovo Legion 5 15IMH05). Windows detected card but nvidia drivers install failed at some point.
On this laptop I did setup bios to use integrated graphics so I can passthru dedicated nvidia.

Think I will give a new try since I follow main.

Are you using laptops for this usecase?

Thanks!

Stephan Althaus <Stephan.Althaus@duedinghausen.eu> escreveu (quinta, 26/06/2025 à(s) 15:50):
On 6/26/25 15:07, Corvin Köhne wrote:
> Hi,
>
> I'm currently experimenting with GPU passthrough for Nvidia cards. All I have to
> do to make it work with Ubuntu guests, is setting the INTPIN register to any
> value instead of just 0x00. Unfortunately, I'm unfamiliar with PCI legacy
> interrupts and how they work. The INTLINE register is set to 0xFF (unconnected).
> So, is it safe to set the INTPIN register or what has to be done for it to work
> as expected?
>
> Any help would be appreciated.
>
>
Hi!

You surely mean 'newer' NVidia cards, as my GT1030 works with FreeBSD
14.2 Host and ubuntu guest, NVIdia driver 570, (and Win guest btw)
out-of-the-box, no kernel/driver modding...

Regards,

Stephan





--
Nuno Teixeira
FreeBSD UNIX:  <eduardo@FreeBSD.org>   Web:  https://FreeBSD.org

Hello!

Oh, laptops... With this "Optimus"-called feature i am not shure if it will work...

But i think it's worth trying.

Maybe you will need the GPU ROM. (https://forums.FreeBSD.org/threads/current-state-of-bhyve-nvidia-passthrough.88244/post-706455)

Good luck!

Stephan


--------------NcnU6sHKEteXYou2EhH0MPcW-- From nobody Fri Jun 27 06:31:36 2025 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4bT5LQ2c4gz60M5H for ; Fri, 27 Jun 2025 06:31:42 +0000 (UTC) (envelope-from Stephan.Althaus@Duedinghausen.eu) Received: from mo4-p05-ob.smtp.rzone.de (mo4-p05-ob.smtp.rzone.de [81.169.146.180]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "*.smtp.rzone.de", Issuer "Telekom Security ServerID OV Class 2 CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4bT5LN3wfBz3WyV for ; Fri, 27 Jun 2025 06:31:40 +0000 (UTC) (envelope-from Stephan.Althaus@Duedinghausen.eu) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=hoewweken.de header.s=strato-dkim-0002 header.b=pC1TDXNS; dkim=pass header.d=hoewweken.de header.s=strato-dkim-0003 header.b="y/d1Mk+I"; dkim=pass header.d=duedinghausen.eu header.s=default header.b=YZ7Dxk30; spf=none (mx1.freebsd.org: domain of Stephan.Althaus@Duedinghausen.eu has no SPF policy when checking 81.169.146.180) smtp.mailfrom=Stephan.Althaus@Duedinghausen.eu; dmarc=pass (policy=reject) header.from=duedinghausen.eu; arc=pass ("strato.com:s=strato-dkim-0002:i=1") ARC-Seal: i=1; a=rsa-sha256; t=1751005897; cv=none; d=strato.com; s=strato-dkim-0002; b=nrvFv3XvMeMHRS7Kd92VxkfT1GK7+AHRnQtgMF8E96EsYcRyRNTogsVJBZHfgV7mZA uAVEiNvLbwAxbVrR+mPzeCBQheXpaFNjjmRznqlY3rAoSxOH06E0qxynpNP9khFrJZhT rOOzmPfjkLmZ5LhL4cQYRo9Cl5foFRK+CEUc/OJ5wKOqwAYat1g3EFcHHzqDEqA+8nJS CRsv7TlyUB3s/7hOZ8Cuf44xlqG/aLjl+Q3gukexksQn8RZ6T/MYluEmqL48nc/hiBmU XDlWMtKqak40eKlEmjU2U246Fst3knIoIiVN318jxa+a0NRjVGP1Gws7tX5fS1xhn9WX m37g== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; t=1751005897; s=strato-dkim-0002; d=strato.com; h=In-Reply-To:From:References:To:Subject:Date:Message-ID:Cc:Date:From: Subject:Sender; bh=fmoKSFnSdLaH3/5qqDmJwX77CXR/vyHfLjT8i5Qlt5Y=; b=L7JaHUsILK4xLrb6qC9uzjvJFVN2M4tmppBOZonIrc7PbcG8PtkOWIHkek++Ja9fwm 22RjqxHv9n/T612LAApGZq7rHeRC/anRflyhh7AKZW+XlREjDoKfAHgziLk1ciPb+tGu PFubAuhRYj6ZHM2pu62/k7tbZrenBwnqOuXhBYnmEofMccGBrOQy2YHmOLLOLZJ4fSdc vgCigwffk2gw0+gFeWwZLpRT/5M9xgBQ0ESOlU6gJIwWctxFxBHInapAsQ8d/NYHXroF GSKbtilSnPVCZWuCfqhwX4pwOz/ojvv2B8B0XToFHNapPl0sZsrMxKFB9bQDzEhpWEU9 EpIw== ARC-Authentication-Results: i=1; strato.com; arc=none; dkim=pass header.d="duedinghausen.eu" header.s="default" header.a="rsa-sha256" DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; t=1751005897; s=strato-dkim-0002; d=hoewweken.de; h=In-Reply-To:From:References:To:Subject:Date:Message-ID:Cc:Date:From: Subject:Sender; bh=fmoKSFnSdLaH3/5qqDmJwX77CXR/vyHfLjT8i5Qlt5Y=; b=pC1TDXNSvEPCIb0XXyCjMronagAIP4TIiYKNx7wDgiMEdXeSApMNUrVp5Q7dguVxxg WPhnF+rKM/WGwdtnb5pawgldgFkQocm/DcU/1XlzFSCSNRrBXNYg0FldcSjHic0pE5O9 JnpPAFH5tzmedQHMn9anVLRDAI+iObfrjII5jgEx+ea61JrRdLmaOuskqAFRLv7pg4NH ZhHC+He5s7wu0/I9opAEzK8R4ty+2146AgnHkuxzJFJMzQWLcwpvGleC+q8f4/v2hcqr Q67tlAnI9/mF+t7ivIMJsHbNEPIbDPSf6cYckfndGlxxbaB4VwClbGn9g6YUrlAtEkc8 hb9w== DKIM-Signature: v=1; a=ed25519-sha256; c=relaxed/relaxed; t=1751005897; s=strato-dkim-0003; d=hoewweken.de; h=In-Reply-To:From:References:To:Subject:Date:Message-ID:Cc:Date:From: Subject:Sender; bh=fmoKSFnSdLaH3/5qqDmJwX77CXR/vyHfLjT8i5Qlt5Y=; b=y/d1Mk+ICR/+rkAotiF0ZxIMy7rCiwX8uhAFbF88zaQe+1xIoCuWKjQtkGuhwMEsdI GQfA+dMF8cr/hUbk5bBA== X-RZG-AUTH: ":O2kGeEG7b/pS1EW2TmikjLDsYYueHLp2aWg0q38nsxvThUrH35SBqNi8UP9PRt5KqGVgfw==" X-RZG-CLASS-ID: mo05 Received: from www.duedinghausen.eu by smtp.strato.de (RZmta 51.3.0 DYNA|AUTH) with ESMTPSA id q88bdf15R6Vb2Sg (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256 bits)) (Client did not present a certificate) for ; Fri, 27 Jun 2025 08:31:37 +0200 (CEST) Received: from [192.168.2.63] (p4fea3d2f.dip0.t-ipconnect.de [79.234.61.47]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange x25519 server-signature ECDSA (secp384r1) server-digest SHA384) (No client certificate requested) (Authenticated sender: steven) by www.duedinghausen.eu (Postfix) with ESMTPSA id 7B56A14F78B for ; Fri, 27 Jun 2025 08:31:37 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=duedinghausen.eu; s=default; t=1751005897; bh=djuEM3jOlQv9yAz9H1ZlDxK3pAw8ZrpWlMh0fi00wPM=; h=Date:Subject:To:References:From:In-Reply-To; b=YZ7Dxk305/ZIGRd6QWSoUyHEYFK0ptFDxrYJRZ7M7BLZReO9aZD9ni3786EVQqEwf 0FkrqIiltcFpXobkWtzlBIXel3JkNtcUdex4tM4TkQeyjCOzyfbvneU29FwNYKz+89 RRuX9ShEt8loWlWaDBgw5TcuFWr3EaEUiV5LDcpVMTtNGsOxTvUdmNaYIZuaqM35aY dEaYAXR2IAVno/PiVMLUYaAKfLSnHWhGrjoqDCHxMGrjQyAmrSGNlqGpmUGAX/ctkR jIUqz51M9UgXZYrzDyLPlmqVlj+A7HExp+vNsKQQ0mtykXVp82oi1+sjrvk8khZ9tu KtcHTC7U788Xboj5ibkG+kZKZjFVfVNCskkJ+cbXfI1q2IqfeFyGZhRS3dd4cjkLmG 0SwQhIkLIetnEDZzvzkDbX2eJ2k2rC1o9SMvrKzqzHJ/C3ojkpNnZ1RGP6A/uC9cTX 8LoxFobBKDsDyXW6Wwobu7F07qIcGPSTzq93SN0iluQR5xWnhgHa9MNmxkMiJJyCWl GA2Ge9zqvPyXNiEegspHlEbTmid9v+3KPavArcz0JUhpR34HOka8NLsGn9WwDpVasE 5S/t5EWWThBzbrljUOwewGj5NyeBUlE2GEkodnwUPJE4hKWdH/+atDcPRqC6cTrMle Cfiq03hCS45Z7vwE03ZVszpA= Content-Type: multipart/alternative; boundary="------------nSwgnso6Ha1bMf5lTjzett29" Message-ID: <90515dd4-3aca-45a2-b43e-3d4558ff5e7f@Duedinghausen.eu> Date: Fri, 27 Jun 2025 08:31:36 +0200 List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: bhyve: GPU passthrough for Nvidia cards To: virtualization@freebsd.org References: <4785074a005d66ed92e5670b9fa4ce45a5d65eba.camel@FreeBSD.org> <89c5f73c-4b7a-4669-a1cf-d2837c096298@Duedinghausen.eu> Content-Language: en-US From: Stephan Althaus In-Reply-To: <89c5f73c-4b7a-4669-a1cf-d2837c096298@Duedinghausen.eu> Content-Transfer-Encoding: 8bit X-Spamd-Result: default: False [-0.23 / 15.00]; URI_COUNT_ODD(1.00)[9]; ARC_ALLOW(-1.00)[strato.com:s=strato-dkim-0002:i=1]; NEURAL_HAM_SHORT(-0.98)[-0.978]; NEURAL_SPAM_LONG(0.92)[0.920]; NEURAL_SPAM_MEDIUM(0.83)[0.830]; DMARC_POLICY_ALLOW(-0.50)[duedinghausen.eu,reject]; R_DKIM_ALLOW(-0.20)[hoewweken.de:s=strato-dkim-0002,hoewweken.de:s=strato-dkim-0003,duedinghausen.eu:s=default]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[81.169.146.180:from]; RWL_MAILSPIKE_GOOD(-0.10)[81.169.146.180:from]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_VIA_SMTP_AUTH(0.00)[]; ASN(0.00)[asn:6724, ipnet:81.169.144.0/22, country:DE]; RCPT_COUNT_ONE(0.00)[1]; RCVD_TLS_ALL(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[virtualization@freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; MLMMJ_DEST(0.00)[virtualization@freebsd.org]; R_SPF_NA(0.00)[no SPF record]; TO_DN_NONE(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; TO_MATCH_ENVRCPT_ALL(0.00)[]; DKIM_TRACE(0.00)[hoewweken.de:+,duedinghausen.eu:+] X-Rspamd-Queue-Id: 4bT5LN3wfBz3WyV X-Spamd-Bar: / This is a multi-part message in MIME format. --------------nSwgnso6Ha1bMf5lTjzett29 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit On 6/27/25 08:00, Stephan Althaus wrote: > On 6/26/25 23:47, Nuno Teixeira wrote: >> Hello Stephan, >> >> A year a go I did try passtrhu a dedicated nvidia GTX 1650 while >> using integrated intel graphics (laptop Lenovo Legion 5 15IMH05). >> Windows detected card but nvidia drivers install failed at some point. >> On this laptop I did setup bios to use integrated graphics so I can >> passthru dedicated nvidia. >> >> Think I will give a new try since I follow main. >> >> Are you using laptops for this usecase? >> >> Thanks! >> >> Stephan Althaus escreveu (quinta, >> 26/06/2025 à(s) 15:50): >> >> On 6/26/25 15:07, Corvin Köhne wrote: >> > Hi, >> > >> > I'm currently experimenting with GPU passthrough for Nvidia >> cards. All I have to >> > do to make it work with Ubuntu guests, is setting the INTPIN >> register to any >> > value instead of just 0x00. Unfortunately, I'm unfamiliar with >> PCI legacy >> > interrupts and how they work. The INTLINE register is set to >> 0xFF (unconnected). >> > So, is it safe to set the INTPIN register or what has to be >> done for it to work >> > as expected? >> > >> > Any help would be appreciated. >> > >> > >> Hi! >> >> You surely mean 'newer' NVidia cards, as my GT1030 works with >> FreeBSD >> 14.2 Host and ubuntu guest, NVIdia driver 570, (and Win guest btw) >> out-of-the-box, no kernel/driver modding... >> >> Regards, >> >> Stephan >> >> >> >> >> >> -- >> Nuno Teixeira >> FreeBSD UNIX:  Web: https://FreeBSD.org >> > > Hello! > > Oh, laptops... With this "Optimus"-called feature i am not shure if it > will work... > > But i think it's worth trying. > > Maybe you will need the GPU ROM. > (https://forums.FreeBSD.org/threads/current-state-of-bhyve-nvidia-passthrough.88244/post-706455) > > Good luck! > > Stephan > > Hi! Whilst trying to get it to work, i would suggest to always shut the host down, not only restart the guest/vm, to be on the safe side. There may be side effects regarding the initialization of the GPU.. When you have a working setup, this may change and you may can reboot the vm and have always a working GPU, maybe.. Regards, Stephan --------------nSwgnso6Ha1bMf5lTjzett29 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: 8bit
On 6/27/25 08:00, Stephan Althaus wrote:
On 6/26/25 23:47, Nuno Teixeira wrote:
Hello Stephan,

A year a go I did try passtrhu a dedicated nvidia GTX 1650 while using integrated intel graphics (laptop Lenovo Legion 5 15IMH05). Windows detected card but nvidia drivers install failed at some point.
On this laptop I did setup bios to use integrated graphics so I can passthru dedicated nvidia.

Think I will give a new try since I follow main.

Are you using laptops for this usecase?

Thanks!

Stephan Althaus <Stephan.Althaus@duedinghausen.eu> escreveu (quinta, 26/06/2025 à(s) 15:50):
On 6/26/25 15:07, Corvin Köhne wrote:
> Hi,
>
> I'm currently experimenting with GPU passthrough for Nvidia cards. All I have to
> do to make it work with Ubuntu guests, is setting the INTPIN register to any
> value instead of just 0x00. Unfortunately, I'm unfamiliar with PCI legacy
> interrupts and how they work. The INTLINE register is set to 0xFF (unconnected).
> So, is it safe to set the INTPIN register or what has to be done for it to work
> as expected?
>
> Any help would be appreciated.
>
>
Hi!

You surely mean 'newer' NVidia cards, as my GT1030 works with FreeBSD
14.2 Host and ubuntu guest, NVIdia driver 570, (and Win guest btw)
out-of-the-box, no kernel/driver modding...

Regards,

Stephan





--
Nuno Teixeira
FreeBSD UNIX:  <eduardo@FreeBSD.org>   Web:  https://FreeBSD.org

Hello!

Oh, laptops... With this "Optimus"-called feature i am not shure if it will work...

But i think it's worth trying.

Maybe you will need the GPU ROM. (https://forums.FreeBSD.org/threads/current-state-of-bhyve-nvidia-passthrough.88244/post-706455)

Good luck!

Stephan


Hi!

Whilst trying to get it to work, i would suggest to always shut the host down, not only restart the guest/vm, to be on the safe side.

There may be side effects regarding the initialization of the GPU..

When you have a working setup, this may change and you may can reboot the vm and have always a working GPU, maybe..

Regards,

Stephan

--------------nSwgnso6Ha1bMf5lTjzett29-- From nobody Fri Jun 27 06:38:37 2025 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4bT5VS0FRgz60MSL for ; Fri, 27 Jun 2025 06:38:40 +0000 (UTC) (envelope-from corvink@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R11" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4bT5VR6f7Fz3Z9k; Fri, 27 Jun 2025 06:38:39 +0000 (UTC) (envelope-from corvink@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1751006319; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references:autocrypt:autocrypt; bh=VzvfA2slPsG3fpGE7J9b7Sx2QC4hNYQF417vh/ptiaw=; b=Kn9gigzgBn+areRkQPGoESLkslxLmIt1OKw8j0teT46rC1A0c4EcNSyHqrrU9O+9bDZ8Th gS2/TcpV0E4j2F7ZtN6pMUxRoV2Zs4iCF+G8F/J1MlQPNx65SVTKLXO6sja4l/u+u7JZVY itd/eDWqhSpkhamzQ+E24hXGr+x70c875f3H0kzkuZlQ5HyIp8aksdgBvoX5lif3Lhot/X PclLsyZa23DZDeky88mFgRxLO+lZ6BYrfvbQAsQphcmx9ry6Z+k8wNEa6rgOHvrpEibFaG 00OXK7R1kHqfimMsQ7wUuz5qgI3tjE02j0XmKD4sA8v5qYhVKygzFG1geVT01Q== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1751006319; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references:autocrypt:autocrypt; bh=VzvfA2slPsG3fpGE7J9b7Sx2QC4hNYQF417vh/ptiaw=; b=ICC7DfJ30ZHPMb4eYf8URLGhJAFMwl6B3n5BniNEz6nsiFW03Eav656JhGj4Y10I1iZ/9+ R9j318qTYs26AV+30LwS4rY+hqXB79ZrXN/yWwyq0ywLc3483pbijEpNaeLjSZMoDbkyBl u83jUjJKdtGgsvVad9ID//u/ZIpiEqWHvcNUbOfnOnv6wiblVlF3YX4R84EUg5em/kYxXO 8ZbIOPO2BRozqYVKeDZzbB7P8KUCq3gbiyOvKMz2AWr/d+tP/ID9lAljYmbtNmfseMzaQ+ 2eXyOu7UxMryCd6k01Ltbgh0ZTPB+Zk1gprDPLselqZbLszNcDWCud5RXnTXmw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1751006319; a=rsa-sha256; cv=none; b=Qv8SrpGHWocjqelCXKW2j0hKKd4Gx1JnEnuk+APcRav+pbafG2M8lKcyxRIQV8NEnU08aC fiuNH4KamOvTLOZyYJQVIgxzPER5HY4rClSTvGyFAxsjNhQG8yIyHMus0Tc60vcwUIjJbA +5cwTD038YMvJGxPUj527lHSC1lKVsA/A3g4BIyhj5CybqJWhFU9j78Rc84uLwZR39bjlF MH5kglmYC0C0Gq9zIjCKmXfaO6tAOLI5ApTsgZL+IcIR0uiyOl5Sbn1BVcsaihJhuASycQ Q9macFtsnd62mN+DzVLvNewdxs8CeYf5CoV/BgmQI5TXWqbI8YVKeYRspAMO4A== Received: from corvink-nb.fritz.box (unknown [IPv6:2001:9e8:dc3c:4b00:d440:3c23:c36a:a166]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (prime256v1) server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: corvink) by smtp.freebsd.org (Postfix) with ESMTPSA id 4bT5VR3cTHz178D; Fri, 27 Jun 2025 06:38:39 +0000 (UTC) (envelope-from corvink@FreeBSD.org) Message-ID: Subject: Re: bhyve: GPU passthrough for Nvidia cards From: Corvin =?ISO-8859-1?Q?K=F6hne?= To: Stephan Althaus , virtualization@freebsd.org Date: Fri, 27 Jun 2025 08:38:37 +0200 In-Reply-To: References: <4785074a005d66ed92e5670b9fa4ce45a5d65eba.camel@FreeBSD.org> Autocrypt: addr=corvink@FreeBSD.org; prefer-encrypt=mutual; keydata=mQINBGNjZaIBEADDTrDNf+0pwiuRPBdClcnZW83dH1UhuOi0u+A1J2SatEBbNaFVtXXAa vewCTuyV/ZbNidjlhq3R/pWyiKjFKvs5dj7PMCw+3z2D5OWpMdHg7TrB+fbdFPOEsu0zQVKNaO+pS KCfN0Re0m7bL3wuvl7PXvBufRwA3Guo1P4j3TXWaEkuso7VupTvE25zVGg9ONHrGOjA9RUy+Yg4Se 3NLgtUdjBgA21SBQTDvRQV4fDmVenlwvWeE0Xm8FcDcpQb6sJTihaDku78mi3Ux1HCk7rTcepVEB0 xIB6qmFxv0sLlDmVv6Z6qg1y/Q5m23Pgz60o3TulMPV4F+3Itm8ifU+wgVSzBZbD29GYkd7LKqMkF bhvfSBk+5db3vbYY5OD//+LTM5AV7e2AhXuXMvG1UNBqXqSJTTSy6KZz+qmPQO0zos0dq46p8o82l KiBEGD2Hu0p+u0OyV+MmRYo1NIBFVbOPXp2MvUVl5II0UIJ3+N9gLBmfGA+HEpVO8PnvdoT/5NQ7m 8JK1rQHzjiDub/iDPAYMqKH4C0eZ/7zO0fuY5FeRNtuNtpH1Bw/+7/5RJH7bcKkfGHHEp15FJUrGH gWNydoDLB9QBprwQc8FEldDXBjzOMXIgh6FGKLNu6DswvIPGy6M3u7DXwDakCXz+c9Ym0oFihLzZx WntrsxdswD/CwARAQABtCdDb3J2aW4gS8O2aG5lIDxjb3J2aW4ua29laG5lQGdtYWlsLmNvbT6JAl QEEwEIAD4WIQSC9FKVreba38fZT0bYVNpWMV4CagUCZArUIwIbAwUJCWYBgAULCQgHAgYVCgkICwI EFgIDAQIeAQIXgAAKCRDYVNpWMV4CalcID/44k2i/mqSSi4W6FAobSF1nFLtP/pfcRNJriWKx2UF7 cfFMKyg7Nilg7FhLb5FDB1umUW2nFfchFPTUp4FfKzgRvPzIMg4RIRcVtTpYbl3z7zs9ZXD8qS//i ibbiUG3quncm6tO2x1jLZD3ORC+8MuLGXhYQIa4O5vVF2SBHdb/U6P+wsrF+U+OpRdEdQ/4Xu9S02 kltzBGgArjcexdhUqEqW01KCCSH0+qgfN1NE+9L934ZOB+cai2b9apPbCOGuV6KcUKMj4z0RWInhl XIyMqtmhdix/P/GjrQ1REVNdp74JeweSSedM15wwc6YLMXPrtOnnExyZ1gyNFYaub+Mdo3ZQ+8386 3B0C9IlpzEW0K8bYlZrl4WBNdcMOyByETAxgQmBgP6ZFErTtaeUOH1nX2FyR6o2GLSahRgngQmnRE zScTpPbBEkMwJMDAO+rbjjGxjeKSUwD1WOfbI6QZj+MS/uBk2p08kgN7fQaCEwj6jqML/IIE+FZ9I In6TNG0hChD384VHO+YioLBno1Atgi4Q7JUWSRIHQXZW+StQajFrWPPyKQwCe1MwqpKoMpX/q8IZB lzwJgZS8ShLeFZjtzOt1jgM99TD91Neonf9OzjTSbfo7sJviSWoICMhB/MvDZjj+naMVF86uGFxnI EsjVKyBxlJd4TRHnLYPTIHFKBLQjQ29ydmluIEvDtmhuZSA8Y29ydmlua0BGcmVlQlNELm9yZz6JA lQEEwEKAD4WIQSC9FKVreba38fZT0bYVNpWMV4CagUCY2NlogIbAwUJCWYBgAULCQgHAwUVCgkICw UWAwIBAAIeAQIXgAAKCRDYVNpWMV4CavfDEACCFnXpR7H9eOgP+GJMNPtK6i9/xnqdyXi8uCZIN0h YwjN4Xzo9SMLOf4UUlQEveOB+bGqbRfHd/fGKnrlXiPd0SGpKWJC21gqL/DsIH0J8I3Whth+O8tfP WeFy0oCsvBaaGFLIrDfoIgHF9i/gqEe48xhN42weB02Z3mdR1L0d7ME/BLwS0mCXe9Zh3uHw63S6x YB3Wsjptxe/ph6TpQDUKWtRJkjC6BqXPBdThpbbfIRWmjZbp2fKEJPvtRXS14+gbUqWeJ4xCvprA3 +ae7vtrp91X775yngyW3XTw5cmDiJIjykH8+zhEIoNQXNBpFrehkQDYrcM+WoE6NGSJo+3VJvSRWh UGWDVrxdTYNkbIjmTNlkI12NINC007DiuV7OF9XHWgrbbylvuZvbODmbJRdhTFy9upAUygX1/xUAQ EIMqMiJmyTdv8i0IbZ611WElQx9XHgGeZgM6+39/laN8FwspM6gE/4NzZHIZN0LEBOerZqoF+Il6e ccQpoEWx7nb/RilJp3dUUyvkBnJWg+AJByosg857kvvmDnZ3UB+bejWpcfFvnbkiKPUBPDO7tWPb5 r2yFDpDe/Vg5x+sRbkkXGUFD6Rx0p/ZiRIneVVg8emTzhDR0IL/BZkq/uVJkdaphZli1F/31cNgf6 ZJYnjxlk86uiYSySZQR0dKLDqq7QlQ29ydmluIEvDtmhuZSA8Yy5rb2VobmVAYmVja2hvZmYuY29t PokCVAQTAQgAPhYhBIL0UpWt5trfx9lPRthU2lYxXgJqBQJkCtScAhsDBQkJZgGABQsJCAcCBhUKC QgLAgQWAgMBAh4BAheAAAoJENhU2lYxXgJqI+QQAML5PTR7KpUFV3SLG60LQJGEOHUfDmJYczxBFb IAq1U4hIbivopu1AdLty7oDDrIjCVoa2/Cy34dd99O7lhLvUmZFB/zDSUtbUg2zhDkU0YSZ11Fdrl Wzky2tFaQRgxpDvWlUP0baa3Pd4dPDRiIUI6AOSR2SL6XANk6sJh56gLVM6G8yyafGsxSyDYg6Z78 EEMFejHwB+KP2DdsahupzM+F97HeC1+bOHYxtqN+2hEkPLtQWizyumPqNg5FvZhwe7yO8V95hF3Rh uDO+9aJT+WLLvcZEb/L1bI04IvZ5FWgCLI7Levd/DuOtZI8gWapHhqGZRbXB2fuJkCoKCl6V67h/7 aWhU3LjFTsC5siJyrxPjapKcIk8a7PqZDswNCKR+24LJ5D59mPgEOnsiCCVpik1WE/kgD+rOu9dQx jpjKwuKowf4EJP1KYNkYtoy1HthzyTOqPwqXC3IUl0GVPO3xw6MhUM3irCVFruC+ecVrv85Rd37vr duT6JvgW92xjWegMsamtkDZH8Ik/cmYhH0K/qEc6OZVNea/4PTEZe0uxODJ6pbMd80AJyGqDPPVeA gWJtEIG4k6IS8XyD5v1QJtlpDVpPwP/bbFnVc3h3Oatfn8Etm1KAqYvNwyO+om2PkF1p732uapDZd LwksVmgc9s79+9pSpeP5DbIeMzhrIK Content-Type: multipart/signed; micalg="pgp-sha512"; protocol="application/pgp-signature"; boundary="=-PW8VyfKl0E1jnwIeBqx1" User-Agent: Evolution 3.56.2 List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 --=-PW8VyfKl0E1jnwIeBqx1 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Thu, 2025-06-26 at 16:49 +0200, Stephan Althaus wrote: > On 6/26/25 15:07, Corvin K=C3=B6hne wrote: > > Hi, > >=20 > > I'm currently experimenting with GPU passthrough for Nvidia cards. All = I > > have to > > do to make it work with Ubuntu guests, is setting the INTPIN register t= o any > > value instead of just 0x00. Unfortunately, I'm unfamiliar with PCI lega= cy > > interrupts and how they work. The INTLINE register is set to 0xFF > > (unconnected). > > So, is it safe to set the INTPIN register or what has to be done for it= to > > work > > as expected? > >=20 > > Any help would be appreciated. > >=20 > >=20 > Hi! >=20 > You surely mean 'newer' NVidia cards, as my GT1030 works with FreeBSD=20 > 14.2 Host and ubuntu guest, NVIdia driver 570, (and Win guest btw) > out-of-the-box, no kernel/driver modding... >=20 > Regards, >=20 > Stephan >=20 >=20 FYI, I'm working on a desktop system with an RTX A500 on 15.0-CURRENT. Ubuntu dmesg reports "NVRM: Can't find an IRQ for your NVIDIA card!" by def= ault. Setting the INTPIN register solve this issue and the card can be detected b= y the nvidia-smi command. However, as mentioned in my initial post, I'm not sure = what has to be emulated to be able to set the INTPIN in a sane way. --=20 Kind regards, Corvin --=-PW8VyfKl0E1jnwIeBqx1 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: This is a digitally signed message part -----BEGIN PGP SIGNATURE----- iQIzBAABCgAdFiEEgvRSla3m2t/H2U9G2FTaVjFeAmoFAmhePG0ACgkQ2FTaVjFe AmouZw//Tfr/DqXm4tjNioW3IYwGAgTgtxww4FMO7UmrimZNwGoYS45jbzaK1cSl cfmkgFPOhDEn4oxpzQnD9ivntBF8/lPcoVrs+dHKZ2bntaircEgDevH0qyE+Brt2 uLv2V0Kciz5CEfzCZwwc/CHwSholwP9fIDciuiPeIab1gtuqKlimpZoSduyJaP14 hkzpMNIPVNJvqdgXGi1dKn3BjNIwvMf3M7NixCCJxT+OH2eyxlwXZ1rG7VnISJQO 87/+qU8XTjPeT9FrzFtT/u6ApeM8++kBOAzbQB0V92U5HsELxq8PZyYZ0NgdtAOZ cCs5VGKopifrInrLzk7+lmsowuf0TOpLolndoFf3APDxyQ/U3gJvVnaG7mDPkgcD zWSZh5ooFfkGREPVDTym508VxjhtkUPkQPjTTA2OdGgmfm/H2IFgBzO2VsHMFhK4 umiXucOglOc63dGy0rzk55hQPB/KmTQ1AN01l5T5UG2JCfo18smQXM0+YnAg0p73 UV3BLptmxSWtQKoJA+HawKhnDpeISqcJ5FrpkejMBINRa3GuF6qFVWA44JkUZLVq 1Bkmwng8EgGmo7bNtSbaryzblLajs+5I04ymJkjJaUpejsB0zyxA8xqJVq+NHTEu pgdjKczQmRNndykRMkbK3wpwMrq6I4ZQxGaYorc86/Jk0ZlqZW4= =HlFW -----END PGP SIGNATURE----- --=-PW8VyfKl0E1jnwIeBqx1-- From nobody Fri Jun 27 07:17:27 2025 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4bT6MK1Rj5z60PJy for ; Fri, 27 Jun 2025 07:17:33 +0000 (UTC) (envelope-from Stephan.Althaus@Duedinghausen.eu) Received: from mo4-p05-ob.smtp.rzone.de (mo4-p05-ob.smtp.rzone.de [81.169.146.181]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "*.smtp.rzone.de", Issuer "Telekom Security ServerID OV Class 2 CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4bT6MH1wnrz3p1N for ; Fri, 27 Jun 2025 07:17:30 +0000 (UTC) (envelope-from Stephan.Althaus@Duedinghausen.eu) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=hoewweken.de header.s=strato-dkim-0002 header.b=h0dIVfmL; dkim=pass header.d=hoewweken.de header.s=strato-dkim-0003 header.b=etzp3Qf3; dkim=pass header.d=duedinghausen.eu header.s=default header.b=Hhbc7VTS; spf=none (mx1.freebsd.org: domain of Stephan.Althaus@Duedinghausen.eu has no SPF policy when checking 81.169.146.181) smtp.mailfrom=Stephan.Althaus@Duedinghausen.eu; dmarc=pass (policy=reject) header.from=duedinghausen.eu; arc=pass ("strato.com:s=strato-dkim-0002:i=1") ARC-Seal: i=1; a=rsa-sha256; t=1751008648; cv=none; d=strato.com; s=strato-dkim-0002; b=A2OdwOR6bfKIr5iADSGEEciOwX7ANZlO2BZ0m05WMJpsVrY5s8/+R/fzyC2WGL7eIz 6FKWqrpfo/X2hGzZHq5DuZx58XH85GF/CkbKgPgULILw/nvqfrwwaBU7B9kZyb4CBzWR Tao4nth901ekEvu6QDoTIQMYqyZu4uc2x3sHn3XfdP8PONWJFvx2sNePO0hXOhLAqXMc dOYhABqqN/Mwmf1xDr4dr32907Cl8Xb/bcYCNuIkgilJ9us9zjTuc42yW6FPZVx1DVkG AQ+6ifXrjsQyqG0j51SOQfCXlSVRrUl86D3SqApJPLxjo+xIIPzlnbiGidR9kRuaYO78 Csyw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; t=1751008648; s=strato-dkim-0002; d=strato.com; h=In-Reply-To:From:References:To:Subject:Date:Message-ID:Cc:Date:From: Subject:Sender; bh=4o4ZonFSBxCSFKpix37sRDiNss2LmyDS3c0RmXZ6kus=; b=GJcGSby46MBiG9AA8LO96COQNuRJcjPbPyihYjGWX8sRqFMJEtdgn2ILChV+TDMtfi ZYno/b0NBGZCh53RfqSXnwQcFTnM1nYJkw4ea1vvebR+GjZAH5ydNz8Y73xuTpkseFGI Lm3faqnJ6mbYkuMgXdmzzdE+c4N/tAeN73wA+nZDqCfmMBZACXXDyg6GB9Q4qwCHMw4K 4y51KMygYx9JXiEcw/9uG7V1KXCF8SsQ4k2mx9qYXS6GLvo6vb1VcHld2rJGqcXyjEIN kIzr76qm27sKKR0sbFjbRZqwRD+epKoeQrhLpSMlBnhAJNI7yGs0kSek3UKSTOOJx0A1 7TBQ== ARC-Authentication-Results: i=1; strato.com; arc=none; dkim=pass header.d="duedinghausen.eu" header.s="default" header.a="rsa-sha256" DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; t=1751008648; s=strato-dkim-0002; d=hoewweken.de; h=In-Reply-To:From:References:To:Subject:Date:Message-ID:Cc:Date:From: Subject:Sender; bh=4o4ZonFSBxCSFKpix37sRDiNss2LmyDS3c0RmXZ6kus=; b=h0dIVfmLv1z40ymw4LAnwtfMXBP1fqblbRZsHVYS1AtvCb7exz/dvIby4WeHreK1Hv TqSFSPKOzGz9sguFYJeHH6XJzmbHTY+/uj0mBkUpGxxfc+IV/W2WurcO0qRXBSrM/OqF rXPNO9owTr/xO/zTc6TJCqQDki3eF6Is9T6wm+AD7JzpC2+ptLjPJapJuxGiU+NTg/+M tEZR8NFvYGfkVC5DIuD3Q2x8pYCg4wqaYTeDoTGV+1wcx0bJMzExXY3PF7joBhpuaAnX 43AHaAIcTlY1khW2Uc5luAS7REOVbbeaffNQjh0B0wsHJaxhaSd7AwPWyj8udjFK9qab 2UzQ== DKIM-Signature: v=1; a=ed25519-sha256; c=relaxed/relaxed; t=1751008648; s=strato-dkim-0003; d=hoewweken.de; h=In-Reply-To:From:References:To:Subject:Date:Message-ID:Cc:Date:From: Subject:Sender; bh=4o4ZonFSBxCSFKpix37sRDiNss2LmyDS3c0RmXZ6kus=; b=etzp3Qf3+jN8spuoAIn6eFaLpiZnCpLyMQ02l01yVeu77fqoFC2EJ4pL6AshmyEGPr SSKcUhwtAb8MU3KYsMDw== X-RZG-AUTH: ":O2kGeEG7b/pS1EW2TmikjLDsYYueHLp2aWg0q38nsxvThUrH35SBqNi8UP9PRt5KqGVgfw==" X-RZG-CLASS-ID: mo05 Received: from www.duedinghausen.eu by smtp.strato.de (RZmta 51.3.0 DYNA|AUTH) with ESMTPSA id q88bdf15R7HS2hO (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256 bits)) (Client did not present a certificate) for ; Fri, 27 Jun 2025 09:17:28 +0200 (CEST) Received: from [192.168.2.63] (p4fea3d2f.dip0.t-ipconnect.de [79.234.61.47]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange x25519 server-signature ECDSA (secp384r1) server-digest SHA384) (No client certificate requested) (Authenticated sender: steven) by www.duedinghausen.eu (Postfix) with ESMTPSA id 4D48014F554 for ; Fri, 27 Jun 2025 09:17:28 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=duedinghausen.eu; s=default; t=1751008648; bh=kW2g3sTOiyuRbaWjREvuAbnHWMO3g2KAP9kDXhSKonY=; h=Date:Subject:To:References:From:In-Reply-To; b=Hhbc7VTSDrhpnM2AvEcj4UsxU519AViySDKCCscucs/CHi+P6bgCEEAz9CjOMHGmd y0S+B8EWc8dD1ZdwiJppzS818lr4IUiBjkfYqT7h5DL4lCcWiR7x2dNPQJAT7Ve+FH YjuglBDHpF7w01iy6p6Vrek2/NOl81rTLOG3Sh61NTp4y3qCyuBfrTVu9UxRjPePwo IGM8VdjutmQN6RVe/010fsPwulzQJzKsZfnxy1uLB9ErBudB82muh0woT0uyvJhxQQ RPe6VcLg0UOGbsZhONAovQ1wbxTO/83KfW+Ir6hA0eoNG52MWm5O+IzQCOc0xx9ZH8 ItY2/tA1twJ1P1hHvTYggxFyhYJWvv/J0rBB/Nibv+wLiC9dvg8zi749lr9pK7rzAN WhvP9uc1okyNjCnZRlcHbD6PoLUeg6L77vKyRyzcgcJL5P/EmRQU9frU1lO4F5TPoH TBc9JqqZosAHC4iz1slemHc0cKpwdlJmPBllFaBSiJLyFBmL0uyEgTJPHc3LH2wb4A P3PdZPqBx9UGuraxGzJiCd3rArguFMg8OBP+jCfQdMSBwR1Tc6h38YNduY4Uw5H1JF 4MqYYUMXmBKgGDddx9aze5iturDlYO5evBQS07uZVK5ZtPZFW3Vdb32gwTkccRtgjA xdey0rOoFDEsAxeuZlQ5FwPs= Message-ID: <1e7c671d-8297-4dc2-bc10-9cc66aac28f1@Duedinghausen.eu> Date: Fri, 27 Jun 2025 09:17:27 +0200 List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: bhyve: GPU passthrough for Nvidia cards To: virtualization@freebsd.org References: <4785074a005d66ed92e5670b9fa4ce45a5d65eba.camel@FreeBSD.org> Content-Language: en-US From: Stephan Althaus In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Spamd-Result: default: False [-3.23 / 15.00]; ARC_ALLOW(-1.00)[strato.com:s=strato-dkim-0002:i=1]; NEURAL_HAM_SHORT(-0.90)[-0.900]; NEURAL_HAM_MEDIUM(-0.82)[-0.824]; DMARC_POLICY_ALLOW(-0.50)[duedinghausen.eu,reject]; NEURAL_SPAM_LONG(0.30)[0.299]; R_DKIM_ALLOW(-0.20)[hoewweken.de:s=strato-dkim-0002,hoewweken.de:s=strato-dkim-0003,duedinghausen.eu:s=default]; MIME_GOOD(-0.10)[text/plain]; RWL_MAILSPIKE_POSSIBLE(0.00)[81.169.146.181:from]; RCPT_COUNT_ONE(0.00)[1]; RCVD_VIA_SMTP_AUTH(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:6724, ipnet:81.169.144.0/22, country:DE]; RCVD_TLS_ALL(0.00)[]; MLMMJ_DEST(0.00)[virtualization@freebsd.org]; PREVIOUSLY_DELIVERED(0.00)[virtualization@freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; R_SPF_NA(0.00)[no SPF record]; TO_DN_NONE(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; TO_MATCH_ENVRCPT_ALL(0.00)[]; DKIM_TRACE(0.00)[hoewweken.de:+,duedinghausen.eu:+] X-Rspamd-Queue-Id: 4bT6MH1wnrz3p1N X-Spamd-Bar: --- On 6/27/25 08:38, Corvin Köhne wrote: > On Thu, 2025-06-26 at 16:49 +0200, Stephan Althaus wrote: >> On 6/26/25 15:07, Corvin Köhne wrote: >>> Hi, >>> >>> I'm currently experimenting with GPU passthrough for Nvidia cards. All I >>> have to >>> do to make it work with Ubuntu guests, is setting the INTPIN register to any >>> value instead of just 0x00. Unfortunately, I'm unfamiliar with PCI legacy >>> interrupts and how they work. The INTLINE register is set to 0xFF >>> (unconnected). >>> So, is it safe to set the INTPIN register or what has to be done for it to >>> work >>> as expected? >>> >>> Any help would be appreciated. >>> >>> >> Hi! >> >> You surely mean 'newer' NVidia cards, as my GT1030 works with FreeBSD >> 14.2 Host and ubuntu guest, NVIdia driver 570, (and Win guest btw) >> out-of-the-box, no kernel/driver modding... >> >> Regards, >> >> Stephan >> >> > FYI, I'm working on a desktop system with an RTX A500 on 15.0-CURRENT. > > Ubuntu dmesg reports "NVRM: Can't find an IRQ for your NVIDIA card!" by default. > Setting the INTPIN register solve this issue and the card can be detected by the > nvidia-smi command. However, as mentioned in my initial post, I'm not sure what > has to be emulated to be able to set the INTPIN in a sane way. > > Hi! I am sorry, i have no knowledge on that topic, how that works in detail. What i can say from my recent tests on various hosts/guests, with my GT1030, that the GPU mostly has INT_PIN 0x01, and the audio device always INT_PIN 0x02. I can't say for sure if it is 'always' because i don't think i have log files for each combination :-/ 00:08.0 VGA compatible controller: NVIDIA Corporation GP108 [GeForce GT 1030] (rev a1) (prog-if 00 [VGA controller])     Subsystem: Micro-Star International Co., Ltd. [MSI] Device 8c98     Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+     Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- SERR- TAbort- SERR-