From nobody Wed Jun 10 14:57:16 2026 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4gb85Z5bYlz6gZnd for ; Wed, 10 Jun 2026 14:57:38 +0000 (UTC) (envelope-from freebsd-virt.eva@winterschon.com) Received: from fhigh-a3-smtp.messagingengine.com (fhigh-a3-smtp.messagingengine.com [103.168.172.154]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4gb85Z1lVFz3YN4; Wed, 10 Jun 2026 14:57:38 +0000 (UTC) (envelope-from freebsd-virt.eva@winterschon.com) Authentication-Results: mx1.freebsd.org; none Received: from phl-compute-02.internal (phl-compute-02.internal [10.202.2.42]) by mailfhigh.phl.internal (Postfix) with ESMTP id 428951400129; Wed, 10 Jun 2026 10:57:37 -0400 (EDT) Received: from phl-imap-04 ([10.202.2.82]) by phl-compute-02.internal (MEProxy); Wed, 10 Jun 2026 10:57:37 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=winterschon.com; h=cc:cc:content-transfer-encoding:content-type:content-type :date:date:from:from:in-reply-to:in-reply-to:message-id :mime-version:references:reply-to:subject:subject:to:to; s=fm2; t=1781103457; x=1781189857; bh=sZqaXKbn5CXENuVHhr9qZr4psEU6sydS 7f25urzupdA=; b=XrAbJzcEKN8f3cnRx0LQX2iGwgVKWhHktL8J2TnYs3FaBA2G nNf+mpGXhczW9Zq192qcdw7rHIGILPzq/nwF4bUG9xrTmKFsHMDKzGMEaOjs1NrN 0dv+nBhtFVaZP4LvBzyek98/rOnMK+fEwQFgDN2bwrOhnBpX2+Fzer7gm8hzteGn k+Ed8QvGYxz9T55bnDkHtfx/JlVnkXO/sZ6AhrCe9FEctgg9fMhrsN2vXmref+C8 BLaATDNBfljQq/loHmqk3QLcx64D9+Ph3HAcozuXGAlJB9eMSA0EeZJMrzIptkYL PPgkpIYo50wkGj0erYrI1Z6oCNng6ehVlgn4hQ== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:cc:content-transfer-encoding :content-type:content-type:date:date:feedback-id:feedback-id :from:from:in-reply-to:in-reply-to:message-id:mime-version :references:reply-to:subject:subject:to:to:x-me-proxy :x-me-sender:x-me-sender:x-sasl-enc; s=fm1; t=1781103457; x= 1781189857; bh=sZqaXKbn5CXENuVHhr9qZr4psEU6sydS7f25urzupdA=; b=O 3TT4aGeUIFM/Ml5k/PX+6SvNMW1RFVIaaKeucDnGqq8J46mghLP/JKiIremsirCK NNBDJqiMVbVAmO4YUox03Pa3bfHQmq+Q3fCenrvD4eks99q93MHBfefcwJgc5JWZ yDphal/XEzu9lIN/PYFTSiXQ/9t/o05YZRaioTdyIyolrrSZ0XLNYPLrbbH+9rs8 2zIUmwZGbftCxszQ5tmaZnaDs3elit+mRM8+4ngcxqCYj77PJQ3KEo3PSDJ3ICsk 0pprDNux5TB/DHqgl47wyOY0VQVbFprcUJLV7Hgxz9Bi1ouLLvLcwrqtze/zXJyg pyEDoYv0m9IoPSOUDHwsQ== X-ME-Sender: X-ME-Proxy-Cause: dmFkZTGgqUBJsdtaIDumZj+/e12qmc/dKPDBerRW/ViiClioDYy43WtaTuaSlf9fcuydZl Wos62VfnlEpB/BrA48hpXGXLLAyQtCiPgd95+R9syt1CtKzfPfmrsVZY9GWH4TTT/iVQ33 cF90LUjtObnV7i0S1geNc0lQBOLqWFz+hopLm2yCzLTdTOU7wfy9lJdSSB6XCSjB1Ck0jT k61KNgIfEdlCX55ckxXjQiYYhDfTKlw6MFfaMvHjhdf2zIdIbpCp/3ZWYXwHUah+lZ+Kkv JBN7RAsGSOdA4MxAPEZw11dlZZ4a8rMCYNnhSW6hwnntwXCWnv08LiKU/bQqclLk7zkBB7 b+E4Q3QR+GT5sPpb5CMi5M87gZTisvCC65Kd7iblraQp/WyZMYxoys8c7NNnLeu5s9TER+ /VAlMGlLL5Tm/gw9zZDSKT1a4Ni8tdDBShkmMro6b9nTcQ6fWCF4SH/VoNnYEwqXBJmrJf dR9jAJOz5PXxSsd5w6uOcsL2ZacESlvNicq5dMK61ARrsu/u+AtkiNCSmyJLjcDEz8K3O3 fJ9ytrJbXvYEAuzMVkRzCgyir4L7HYHWGgUoiYPKWCBS5mSbtNhrJIy+QL/5gO/ew3dosV 1hUKyLPtIYmfIFKRdToK8OmSKhZY/fQr2ttgr/18rSaODYjWIGDF1PPYT4Kw X-ME-Proxy: Feedback-ID: ic82e4800:Fastmail Received: by mailuser.phl.internal (Postfix, from userid 501) id D3698B6006F; Wed, 10 Jun 2026 10:57:36 -0400 (EDT) X-Mailer: MessagingEngine.com Webmail Interface List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org List-Id: List-Post: List-Help: List-Subscribe: List-Unsubscribe: List-Owner: Precedence: list MIME-Version: 1.0 X-ThreadId: AE99iQLxoqTg Date: Wed, 10 Jun 2026 07:57:16 -0700 From: =?UTF-8?Q?Eva_Wintersch=C3=B6n?= To: "Mario Marietto" , =?UTF-8?Q?Corvin_K=C3=B6hne?= Cc: "Matthew Grooms" , virtualization@freebsd.org Message-Id: In-Reply-To: References: <1bbf28a7-7025-4d83-937d-72d8583048ca@shrew.net> <368dc4ea87fea1c1082c5e54e4140f3cb43075a9.camel@FreeBSD.org> Subject: =?UTF-8?Q?Re:_**[Help]_bhyve:_bootrom=5Falloc:_vm=5Fmmap=5Fmapseg:_Inval?= =?UTF-8?Q?id_argument_=E2=80=94_NVIDIA_passthrough_with_Corvin's_branch?= =?UTF-8?Q?_on_FreeBSD_15.0**?= Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:151847, ipnet:103.168.172.0/24, country:AU] X-Rspamd-Queue-Id: 4gb85Z1lVFz3YN4 X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated Hi Mario, I have perhaps too many nvidia GPUs, from Maxwell generation to Kepler, = Pascal, Turing, Ampere, and GB10 series, with consumer RTX in the mix bu= t mostly datacenter grade SKUs from those series. Some are in systems, s= ome are in boxes, some will never be used, some have passive cooling, so= me have active, etc. Otherwise to say, generations of GPUs are important= for testing compatibility and operational consistency. I can potentiall= y run the same tests if there's more detailed information. Back when I had time for anything other than wasting my attention span o= n cleaning up the security messes from May's Github CVE, I was running a= lot of test-bench and workload profiling on 14.x with bhyve passthrough= for nvidia as well as CUDA support (without virtualization involved). W= hile reading these threads I wonder about the following: 1. What does your test harness look like? 2. What is your kernel config? 3. What version and config of everything is in use on the OS (hardware s= pecs, uefi with/without csm enabled, x2acpi opt-out, pcie lane settings,= aspm settings, bhyve global settings, qemu settings, vm specific settin= gs, pciconf output, uefi loader settings/flags, loader.conf settings, rc= .conf settings, pkg versions, driver versions, firmware version for the = MB and BMC, sysctl.conf settings, firmware version on the GPU, model of = GPU, nvidia driver version, etc) 4. Are you tracking and keeping syslog entries from the start to end of = the test runs? 5. Are you using additional process debugging for bhyve, kernel debug sy= mbol support, using drace + flamegraphs etc. 6. Which method of patching is used, what exactly was observed every tim= e a test iteration occurred? how idempotent and repeatable are your test= s? There's a lot of work to get from "doesn't work" to "it works", includin= g the necessary definition of "works" (are we talking, the VM can see th= e GPU, or the VM can use the GPU, the VM can see and use the GPU and als= o execute CUDA workloads on the GPU). Thanks, Eva On Wed, Jun 10, 2026, at 02:18, Mario Marietto wrote: > --> Does it occur on stock 15? . > > Error happened with stock 15 upgraded until 15p9. > > ---> Nvidia GPU passthrough should work on stock 15, so Please test it=20 > without patching any files. > > I asked Claude to create the patches because it didn't work with stock=20 > 15. With the patches created by Claude that I have applied it worked=20 > again. > > Mario. > > On Wed, Jun 10, 2026 at 10:59=E2=80=AFAM Corvin K=C3=B6hne wrote: >> On Tue, 2026-06-09 at 08:40 +0200, Mario Marietto wrote: >> > --- >> > > https://github.com/freebsd/freebsd-src/commit/effcd0ded0ef1c92bef= 29c1e9bbf51 >> > 7c97bb45b8 >> >=20 >> > oh ok. That's not the bug I was talking about. You gave no reply ab= out that >> > (bhyve: bootrom_alloc: vm_mmap_mapseg: Invalid argument on FreeBSD = 15*- >> > RELEASE).=20 >> >=20 >>=20 >> Does it occur on stock 15? Nvidia GPU passthrough should work on stoc= k 15, so >> please test it without patching any files. >>=20 >>=20 >> --=20 >> Best regards, >> Corvin > > > --=20 > Mario.