Date: Mon, 06 Jan 2025 15:40:59 +0100 From: Corvin =?ISO-8859-1?Q?K=F6hne?= <corvink@FreeBSD.org> To: Peter Wood <peter@alastria.net> Cc: freebsd-virtualization@freebsd.org Subject: Re: bhyve/passthru for Intel dGPU (ARC A380)? Message-ID: <d2f9347053741ceab43d925ad22448f325559974.camel@FreeBSD.org> In-Reply-To: <CAD-E2ieq0P03tTkuAdvg-D35ua9PQT6XuT9GHOPLc7Aqa6xGvw@mail.gmail.com> References: <CAD-E2if_q6JreqPWiFBgPc=KHeP12Pq_E2R4m3ZxvGC3g87ZHA@mail.gmail.com> <CA%2B1FSihc5EiBUSFjxoUViAYzZ3qbo%2BqpssrBkuEvQK1=O9W6uw@mail.gmail.com> <CAD-E2icA%2BHkWZJL2JVjU28ECpc8BNG1KXkpQj4Zw5nB8yPfahQ@mail.gmail.com> <d2e6638855f263e8f613ba06c37e091c710c27be.camel@FreeBSD.org> <CAD-E2ieq0P03tTkuAdvg-D35ua9PQT6XuT9GHOPLc7Aqa6xGvw@mail.gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
--=-ROMEs70aYfmzhmJO/I+c Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Mon, 2025-01-06 at 13:56 +0000, Peter Wood wrote: > Thanks for the feedback Corvin, and thank you for the hard work you've be= en > putting into GPU passthru. >=20 > I'm reaching the end of my limited knowledge here, and I have no expectat= ion > of any further assistance - but as a status update, BIOS in CSM (with leg= acy > video op rom, so I see the console). >=20 > > If you want to pass the option rom to the guest, you can use the rom op= tion > > of > > passthru devices: > >=20 > > -s 1/2/3,passthru,1/2/3,rom=3D/path/to/rom > >=20 >=20 >=20 > I extracted the option ROM using linux, I was able to use the > /sys/devices/pci*/rom route to extract it, it seems valid at a glance (76= 8k > dump) - but no idea how to really tell. >=20 > Using the patched bhyve executable to bypass gvt-d: -s > 4/0/0,passthru,4/0/0,rom=3D/mnt/vm/intel-arc-a380.bin -s 5/0/0,passthru,5= /0/0 > (5/0/0 is a separate audio device exposing the audio channels of the HDMI > ports). >=20 > Sadly initialization of the GPU in the linux (Ubuntu 24.04 / linux 6.8.0)= VM > still fails: > [ =C2=A0 =C2=A02.508656] i915 0000:00:04.0: enabling device (0000 -> 0002= ) > [ =C2=A0 =C2=A02.520226] i915 0000:00:04.0: [drm] Local memory IO size: > 0x000000017c800000 > [ =C2=A0 =C2=A02.520232] i915 0000:00:04.0: [drm] Local memory available: > 0x000000017c800000 > [ =C2=A0 =C2=A02.540148] i915 0000:00:04.0: vgaarb: VGA decodes changed: > olddecodes=3Dio+mem,decodes=3Dnone:owns=3Dnone > [ =C2=A0 =C2=A02.550829] i915 0000:00:04.0: [drm] Finished loading DMC fi= rmware > i915/dg2_dmc_ver2_08.bin (v2.8) > [ =C2=A0 =C2=A02.564885] i915 0000:00:04.0: [drm] GT0: GUC: ADS capture a= lloc size > changed from 32768 to 36864 > [ =C2=A0 =C2=A02.565855] i915 0000:00:04.0: [drm] GT0: GuC firmware i915/= dg2_guc_70.bin > version 70.20.0 > [ =C2=A0 =C2=A02.565859] i915 0000:00:04.0: [drm] GT0: HuC firmware i915/= dg2_huc_gsc.bin > version 7.10.3 > [ =C2=A0 =C2=A02.565979] i915 0000:00:04.0: [drm] GT0: GUC: ADS capture a= lloc size > changed from 32768 to 36864 > [ =C2=A0 =C2=A02.567001] i915 0000:00:04.0: [drm] GT0: GUC: load failed: = status =3D > 0x40000056, time =3D 0ms, freq =3D 2300MHz, ret =3D 0 > [ =C2=A0 =C2=A02.567006] i915 0000:00:04.0: [drm] GT0: GUC: load failed: = status: Reset =3D > 0, BootROM =3D 0x2B, UKernel =3D 0x00, MIA =3D 0x00, Auth =3D 0x01 > [ =C2=A0 =C2=A02.567009] i915 0000:00:04.0: [drm] GT0: GUC: firmware prod= uction part > check failure > [ =C2=A0 =C2=A02.567077] i915 0000:00:04.0: [drm] *ERROR* GT0: GuC initia= lization failed > -ENOEXEC > [ =C2=A0 =C2=A02.567610] i915 0000:00:04.0: [drm] *ERROR* GT0: Enabling u= c failed (-5) > [ =C2=A0 =C2=A02.567949] i915 0000:00:04.0: [drm] *ERROR* GT0: Failed to = initialize GPU, > declaring it wedged! > [ =C2=A0 =C2=A02.570106] i915 0000:00:04.0: [drm:add_taint_for_CI [i915]]= CI tainted:0x9 > by intel_gt_set_wedged_on_init+0x34/0x50 [i915] > [ =C2=A0 =C2=A02.587048] [drm] Initialized i915 1.6.0 20230929 for 0000:0= 0:04.0 on minor > 1 >=20 If possible, it might be a good idea to check if it's running on a Linux ho= st with QEMU properly. If yes, we may be able to check if QEMU has some specia= l quirks for those devices (don't see one yet). > Interestingly intel_gpu_top will interact with the card to a degree, it s= hows > a render utilization (of 0%), but none of the other card capabilities. Th= ere > are some very similar errors in Google which may suggest it's may not be = a > bhyve/passthru issue, though it could be. I need to spin up a new VM with= more > bleeding edge linux (or maybe even Win11) to see if it can talk to the ca= rd. >=20 > https://github.com/intel-analytics/ipex-llm/issues/12122 >=20 > I'll post if I get any further, but I suspect this is the end for now. >=20 Hmm, the issues you've posted is related to resizable BARs. I'm not familia= r with it but afaik, bhyve isn't able to emulate resizable BARs yet. Btw. resizable BARs are somehow supported by QEMU, so it might be worth giv= ing it a try: https://gitlab.com/qemu-project/qemu/-/commit/b5048a4cbfa0362abc720b5198fe9= a35441bf5fe > Peter. > --=20 > Peter Wood > peter@alastria.net >=20 --=20 Kind regards, Corvin --=-ROMEs70aYfmzhmJO/I+c Content-Type: application/pgp-signature; name="signature.asc" Content-Description: This is a digitally signed message part -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEEgvRSla3m2t/H2U9G2FTaVjFeAmoFAmd763sACgkQ2FTaVjFe Amri8w/8CBq7bGS2fMHQw3P7AEzJLV7nSslm4m6mIdMwwSWHHC7fF5kwPIBw4nUH pQbxhRyns0hlmvJul93La8mpnTCQ1EPozxS/PtK/r36d/j1zPa44JoLWAYrYupkR 8OYEQiBJvU9eE/yT/59v5ebq/s4cV547HhsbZ15ubBA3ZT9Is2kadE376WC7GgD9 xxY19pQM9B3EgW0GUC7AXLj57KCFaPnl15uJ4XssofDetyrOrbTl8TbIu/LmDSsh 7k+pmX8KII9oOsDIdLjL/RFNvNVeapz3TiDjFgSUKLnDfmE2eU5FksgORVu5JH/M fWhHemantla3bJouZ7MqBijRQcjCKeC+FzcMPBBVWH0Q91/PpjMLlyvqHxmu8xHB XT6b7pv1EQ2JfbvkVvhlb42AmvN4pjEq09zsIME445OI2iQV8t2AAMKNMbSY4jbD pr74494PR5u4I+BvNmdJRCxS/rml9oAg50y1sKftBeUf5/rUlkmLUIz5QhjxIU1d kLIPVwn++GILRlw4QXxkj+nc66sgv9f9nFoo3eQ7Wgp/I/9RMsYqspHIdQhWGYgt 9Rj92ZSxLZJk29MJpQaOXLKSwSs9jn0/asVtG0NDq5HyMK87gGjivZTO91Cj4lXw h4X/NCV3uh4GbG68uB79Ojs0fEHW66NcvhbSoV96iAbwVmjZsi4= =eZg9 -----END PGP SIGNATURE----- --=-ROMEs70aYfmzhmJO/I+c--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?d2f9347053741ceab43d925ad22448f325559974.camel>