From nobody Mon May 26 06:01:11 2025 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4b5QB20JBQz5xJcM for ; Mon, 26 May 2025 06:01:14 +0000 (UTC) (envelope-from corvink@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R11" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4b5QB16F1vz3Kyp; Mon, 26 May 2025 06:01:13 +0000 (UTC) (envelope-from corvink@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1748239273; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references:autocrypt:autocrypt; bh=8ST0HZwjlnTLhCrI124UMXIZEH3kNO4rYPtsbt/LiaQ=; b=KLBItdQaPmZiolWsGjJDdlRl99YkbBa5KNhJNgM3NtkGA0isHNF39SXhZn8CRaJe0Rf9lC +bwMwN3o7JLU06F/BDRLBf7G/p1L6Lp3WBnu4SI8AwwPERYp64DWt+QtbUORZjJm1LkCHj mE6bnzQ96xqx6zlmubZQybpfsKGA0EIfRX1iZK3hjkwp5OBaapQLQvvqdywoEmNZqHJesO g/ZrtCR1RY/9MBioqxvjPkvs+vOr6rTdotwtKgTihb8/TebwSOA7+2xUbdSu81/iEhMFAo XRP9/4wq2noH9YBuijy8Qudl6GHICfC2xWA7QSaGBxL80defNjlUhAoCE5FL7w== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1748239273; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references:autocrypt:autocrypt; bh=8ST0HZwjlnTLhCrI124UMXIZEH3kNO4rYPtsbt/LiaQ=; b=srldJ+w6il+v6gDPHVfsjNINReCobhgHdarXZKjpM3W08Fqr2yNylPFTTAVbH/kJHNQrMb F0payaiIjSqbE+PVAfA2o7MYL7q/dXJRGZUfZ0+kyTWrTKZEwFL6o2hw66KhKLpsh/zgtS uDJWBLxjuN0m+MkxktGtzyD+pETYSth/1dtGIiijBy6Ef0pK6qANtisUEXqeVCkTxOBBom qDWCCiaPeXay3ELsuXXL9T88dxWkpTuIzqf/amcMKW271G6P1T2T/maja3p61cGFhSV7HA BGWgntw4n7yt2H5Ih+b22YyXLtdAqu0h5f0EskIvv0z8PdWlA2YJxhZqDHMJVg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1748239273; a=rsa-sha256; cv=none; b=X3B4WhGmQ2VqYofLq5KUE9ew7kQdpIBsq+JIQTzB8k1yYnsZl2ArkKqXSBd2VAAoelztVa 6jKP0aBCR67feGGncF0hdnG8xrdxNZhWSAH2WyGPYS7Mw4ansTCYOIHZ6M00/XFJfbhNDB nOFaPqNHpBK35wQzqDhvGDcF2CPoIV9kVeoR59ejUAp1w4wHjNactgE79WwhBSPBOz/EXY u8+fqCpvvXMsB/VAZTQGB7DO7yI637hEMkKiIOO3UFKNM8I3mipnJI4nvRoDxSEEfK+0cN VUproAZuzMxFDkveY9MQisncPpSMxSAkwR4QdOBEXplFvVoBnRx6WvzyR1x9qw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none Received: from [172.21.179.108] (unknown [195.226.174.194]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (prime256v1) server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: corvink) by smtp.freebsd.org (Postfix) with ESMTPSA id 4b5QB12lJBzqYR; Mon, 26 May 2025 06:01:13 +0000 (UTC) (envelope-from corvink@FreeBSD.org) Message-ID: <7378d313b05a5504e1554b5d43b4433f2fce2ff7.camel@FreeBSD.org> Subject: Re: bhyve: bootindex= not working? From: Corvin =?ISO-8859-1?Q?K=F6hne?= To: Roman Bogorodskiy , virtualization@freebsd.org Date: Mon, 26 May 2025 08:01:11 +0200 In-Reply-To: References: Autocrypt: addr=corvink@FreeBSD.org; prefer-encrypt=mutual; keydata=mQINBGNjZaIBEADDTrDNf+0pwiuRPBdClcnZW83dH1UhuOi0u+A1J2SatEBbNaFVtXXAa vewCTuyV/ZbNidjlhq3R/pWyiKjFKvs5dj7PMCw+3z2D5OWpMdHg7TrB+fbdFPOEsu0zQVKNaO+pS KCfN0Re0m7bL3wuvl7PXvBufRwA3Guo1P4j3TXWaEkuso7VupTvE25zVGg9ONHrGOjA9RUy+Yg4Se 3NLgtUdjBgA21SBQTDvRQV4fDmVenlwvWeE0Xm8FcDcpQb6sJTihaDku78mi3Ux1HCk7rTcepVEB0 xIB6qmFxv0sLlDmVv6Z6qg1y/Q5m23Pgz60o3TulMPV4F+3Itm8ifU+wgVSzBZbD29GYkd7LKqMkF bhvfSBk+5db3vbYY5OD//+LTM5AV7e2AhXuXMvG1UNBqXqSJTTSy6KZz+qmPQO0zos0dq46p8o82l KiBEGD2Hu0p+u0OyV+MmRYo1NIBFVbOPXp2MvUVl5II0UIJ3+N9gLBmfGA+HEpVO8PnvdoT/5NQ7m 8JK1rQHzjiDub/iDPAYMqKH4C0eZ/7zO0fuY5FeRNtuNtpH1Bw/+7/5RJH7bcKkfGHHEp15FJUrGH gWNydoDLB9QBprwQc8FEldDXBjzOMXIgh6FGKLNu6DswvIPGy6M3u7DXwDakCXz+c9Ym0oFihLzZx WntrsxdswD/CwARAQABtCdDb3J2aW4gS8O2aG5lIDxjb3J2aW4ua29laG5lQGdtYWlsLmNvbT6JAl QEEwEIAD4WIQSC9FKVreba38fZT0bYVNpWMV4CagUCZArUIwIbAwUJCWYBgAULCQgHAgYVCgkICwI EFgIDAQIeAQIXgAAKCRDYVNpWMV4CalcID/44k2i/mqSSi4W6FAobSF1nFLtP/pfcRNJriWKx2UF7 cfFMKyg7Nilg7FhLb5FDB1umUW2nFfchFPTUp4FfKzgRvPzIMg4RIRcVtTpYbl3z7zs9ZXD8qS//i ibbiUG3quncm6tO2x1jLZD3ORC+8MuLGXhYQIa4O5vVF2SBHdb/U6P+wsrF+U+OpRdEdQ/4Xu9S02 kltzBGgArjcexdhUqEqW01KCCSH0+qgfN1NE+9L934ZOB+cai2b9apPbCOGuV6KcUKMj4z0RWInhl XIyMqtmhdix/P/GjrQ1REVNdp74JeweSSedM15wwc6YLMXPrtOnnExyZ1gyNFYaub+Mdo3ZQ+8386 3B0C9IlpzEW0K8bYlZrl4WBNdcMOyByETAxgQmBgP6ZFErTtaeUOH1nX2FyR6o2GLSahRgngQmnRE zScTpPbBEkMwJMDAO+rbjjGxjeKSUwD1WOfbI6QZj+MS/uBk2p08kgN7fQaCEwj6jqML/IIE+FZ9I In6TNG0hChD384VHO+YioLBno1Atgi4Q7JUWSRIHQXZW+StQajFrWPPyKQwCe1MwqpKoMpX/q8IZB lzwJgZS8ShLeFZjtzOt1jgM99TD91Neonf9OzjTSbfo7sJviSWoICMhB/MvDZjj+naMVF86uGFxnI EsjVKyBxlJd4TRHnLYPTIHFKBLQjQ29ydmluIEvDtmhuZSA8Y29ydmlua0BGcmVlQlNELm9yZz6JA lQEEwEKAD4WIQSC9FKVreba38fZT0bYVNpWMV4CagUCY2NlogIbAwUJCWYBgAULCQgHAwUVCgkICw UWAwIBAAIeAQIXgAAKCRDYVNpWMV4CavfDEACCFnXpR7H9eOgP+GJMNPtK6i9/xnqdyXi8uCZIN0h YwjN4Xzo9SMLOf4UUlQEveOB+bGqbRfHd/fGKnrlXiPd0SGpKWJC21gqL/DsIH0J8I3Whth+O8tfP WeFy0oCsvBaaGFLIrDfoIgHF9i/gqEe48xhN42weB02Z3mdR1L0d7ME/BLwS0mCXe9Zh3uHw63S6x YB3Wsjptxe/ph6TpQDUKWtRJkjC6BqXPBdThpbbfIRWmjZbp2fKEJPvtRXS14+gbUqWeJ4xCvprA3 +ae7vtrp91X775yngyW3XTw5cmDiJIjykH8+zhEIoNQXNBpFrehkQDYrcM+WoE6NGSJo+3VJvSRWh UGWDVrxdTYNkbIjmTNlkI12NINC007DiuV7OF9XHWgrbbylvuZvbODmbJRdhTFy9upAUygX1/xUAQ EIMqMiJmyTdv8i0IbZ611WElQx9XHgGeZgM6+39/laN8FwspM6gE/4NzZHIZN0LEBOerZqoF+Il6e ccQpoEWx7nb/RilJp3dUUyvkBnJWg+AJByosg857kvvmDnZ3UB+bejWpcfFvnbkiKPUBPDO7tWPb5 r2yFDpDe/Vg5x+sRbkkXGUFD6Rx0p/ZiRIneVVg8emTzhDR0IL/BZkq/uVJkdaphZli1F/31cNgf6 ZJYnjxlk86uiYSySZQR0dKLDqq7QlQ29ydmluIEvDtmhuZSA8Yy5rb2VobmVAYmVja2hvZmYuY29t PokCVAQTAQgAPhYhBIL0UpWt5trfx9lPRthU2lYxXgJqBQJkCtScAhsDBQkJZgGABQsJCAcCBhUKC QgLAgQWAgMBAh4BAheAAAoJENhU2lYxXgJqI+QQAML5PTR7KpUFV3SLG60LQJGEOHUfDmJYczxBFb IAq1U4hIbivopu1AdLty7oDDrIjCVoa2/Cy34dd99O7lhLvUmZFB/zDSUtbUg2zhDkU0YSZ11Fdrl Wzky2tFaQRgxpDvWlUP0baa3Pd4dPDRiIUI6AOSR2SL6XANk6sJh56gLVM6G8yyafGsxSyDYg6Z78 EEMFejHwB+KP2DdsahupzM+F97HeC1+bOHYxtqN+2hEkPLtQWizyumPqNg5FvZhwe7yO8V95hF3Rh uDO+9aJT+WLLvcZEb/L1bI04IvZ5FWgCLI7Levd/DuOtZI8gWapHhqGZRbXB2fuJkCoKCl6V67h/7 aWhU3LjFTsC5siJyrxPjapKcIk8a7PqZDswNCKR+24LJ5D59mPgEOnsiCCVpik1WE/kgD+rOu9dQx jpjKwuKowf4EJP1KYNkYtoy1HthzyTOqPwqXC3IUl0GVPO3xw6MhUM3irCVFruC+ecVrv85Rd37vr duT6JvgW92xjWegMsamtkDZH8Ik/cmYhH0K/qEc6OZVNea/4PTEZe0uxODJ6pbMd80AJyGqDPPVeA gWJtEIG4k6IS8XyD5v1QJtlpDVpPwP/bbFnVc3h3Oatfn8Etm1KAqYvNwyO+om2PkF1p732uapDZd LwksVmgc9s79+9pSpeP5DbIeMzhrIK Content-Type: multipart/signed; micalg="pgp-sha256"; protocol="application/pgp-signature"; boundary="=-gVVni4qg9wr3Uxf42J6d" User-Agent: Evolution 3.56.1 List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 --=-gVVni4qg9wr3Uxf42J6d Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Sun, 2025-05-25 at 13:14 +0200, Roman Bogorodskiy wrote: > Hi, >=20 > I'm trying to understand how to use bootindex=3D configuration for disk > devices. >=20 > I start with a fresh copy of the VARs file: >=20 > sudo cp /usr/local/share/uefi-firmware/BHYVE_UEFI_VARS.fd > /data/vars/freebsd_VARS.fd >=20 > Then start a VM: >=20 > sudo bhyve -c 2 -m 4096 -A -I -u -H -P > \=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=20 > -s 0:0,hostbridge \ > -l bootrom,/usr/local/share/uefi- > firmware/BHYVE_UEFI.fd,/data/vars/freebsd_VARS.fd,fwcfg=3Dqemu \ > -s 2:0,xhci,tablet -s 1:0,lpc \ > -s 3:0,ahci,hd:/data/img/freebsd.img,bootindex=3D1,cd:/data/isos/FreeBSD-= 14.2- > RELEASE-amd64-disc1.iso,bootindex=3D2 \ > -s 5:0,fbuf,tcp=3D127.0.0.1:5920 -l com1,/dev/nmdm5A \ > freebsd >=20 > With this configuration I expect it to boot from the "hd" device. Instead= , it > boots into the installer. >=20 > In the installer I see: >=20 > # efibootmgr -v > Boot to FW : false > BootCurrent: 0001 > Timeout=C2=A0=C2=A0=C2=A0 : 0 seconds > BootOrder=C2=A0 : 0000, 0001, 0002, 0003 > =C2=A0Boot0000* UiApp Fv(7cb8bdc9-f8eb-4f34-aaea-3ee4af6516a1)/FvFile(462= caa21- > 7614-4503-836e-8ab6f4662331) > +Boot0001* UEFI BHYVE SATA DVD ROM BHYVE-6057-BC56-DB6C > PciRoot(0x0)/Pci(0x3,0x0)/Sata(0x1,0xffff,0x0) > =C2=A0Boot0002* UEFI BHYVE SATA DISK BHYVE-412B-5D46-BC34 > PciRoot(0x0)/Pci(0x3,0x0)/Sata(0x0,0xffff,0x0) > =C2=A0Boot0003* EFI Internal Shell Fv(7cb8bdc9-f8eb-4f34-aaea- > 3ee4af6516a1)/FvFile(7c04a583-9e3e-4f1c-ad65-e05268d0b4d1) >=20 >=20 > Unreferenced Variables: > # >=20 > I thought maybe it doesn't pay attention to bootindex=3D when the VARs > file is specified, so I tried like this: >=20 > sudo bhyve -c 2 -m 4096 -A -I -u -H -P \ > -s 0:0,hostbridge \ > -l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd,fwcfg=3Dqemu \= =20 > -s 2:0,xhci,tablet -s 1:0,lpc \ > -s 3:0,ahci,hd:/data/img/freebsd.img,bootindex=3D1,cd:/data/isos/FreeBSD-= 14.2- > RELEASE-amd64-disc1.iso,bootindex=3D2 \ > -s 5:0,fbuf,tcp=3D127.0.0.1:5920 -l com1,/dev/nmdm5A \ > freebsd >=20 > Result is the same. >=20 > Also, instead of this: >=20 > -s 3:0,ahci,hd:/data/img/freebsd.img,bootindex=3D1,cd:/data/isos/FreeBSD-= 14.2- > RELEASE-amd64-disc1.iso,bootindex=3D2 \ >=20 > I've tried: >=20 > -s 3:0,ahci-hd,/data/img/freebsd.img,bootindex=3D1 -s 4:0,ahci- > cd,/data/isos/FreeBSD-14.2-RELEASE-amd64-disc1.iso,bootindex=3D2 \ >=20 > No difference. >=20 > No, going back to the very first command I used. In the installer's > shell, I execute: >=20 > # efibootmgr -o 0002 > Boot to FW : false > BootCurrent: 0001 > Timeout=C2=A0=C2=A0=C2=A0 : 0 seconds > BootOrder=C2=A0 : 0002 > =C2=A0Boot0002* UEFI BHYVE SATA DISK BHYVE-412B-5D46-BC34 > # >=20 > And reboot. It boots from the disk now, according to the configuration: >=20 > root@freebsd:~ # efibootmgr -v > Boot to FW : false > BootCurrent: 0002 > Timeout=C2=A0=C2=A0=C2=A0 : 0 seconds > BootOrder=C2=A0 : 0002, 0000, 0001, 0003 > +Boot0002* UEFI BHYVE SATA DISK BHYVE-412B-5D46-BC34 > PciRoot(0x0)/Pci(0x3,0x0)/Sata(0x0,0xffff,0x0) > =C2=A0Boot0000* UiApp Fv(7cb8bdc9-f8eb-4f34-aaea-3ee4af6516a1)/FvFile(462= caa21- > 7614-4503-836e-8ab6f4662331) > =C2=A0Boot0001* UEFI BHYVE SATA DVD ROM BHYVE-6057-BC56-DB6C > PciRoot(0x0)/Pci(0x3,0x0)/Sata(0x1,0xffff,0x0) > =C2=A0Boot0003* EFI Internal Shell Fv(7cb8bdc9-f8eb-4f34-aaea- > 3ee4af6516a1)/FvFile(7c04a583-9e3e-4f1c-ad65-e05268d0b4d1) >=20 >=20 > Unreferenced Variables: > root@freebsd:~ # >=20 > Now, if I swap the bootindex=3D values to force to boot from the CD, it > also has no effect, from now on it'll be booting from the disk. >=20 > All in all, it looks like it stores boot options in the VARS file > properly, but completely ignores the bootindex command line > configuration. >=20 > Is it a bug somewhere or am I doing something wrong? >=20 > I'm running 15.0-CURRENT ~1 month old and edk2-bhyve-g202308_5. > Guest is FreeBSD 14.2-RELEASE. >=20 > Thanks, > Roman >=20 Hi Roman, EDKII honors bootindex since 202408 [1]. So, our latest EDKII port, based o= n 202308, is too old. [1] https://github.com/tianocore/edk2/commit/ffce430d2b65d508a1604dc986ba16db35= 83943d --=20 Kind regards, Corvin --=-gVVni4qg9wr3Uxf42J6d Content-Type: application/pgp-signature; name="signature.asc" Content-Description: This is a digitally signed message part -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEEgvRSla3m2t/H2U9G2FTaVjFeAmoFAmg0A6cACgkQ2FTaVjFe Ampp0BAAw0S4mnIxmRCNAyMHNkEHyN6YLQ/xrF/BOFeLpZxVVPRrVWm2dFL4odIL qErkBXRqwMcPU31hGh9Yy7yVvMWD+HmvgrzMQYV1WuiZUPP5HJ1cZ8pqXP2d/tOJ 2/0KfyfwSuXmPyilwargNX7rqpmcpllFpJLs602z9Bcj+XGk9ZUOUK79+oDxCHR/ oUQ7ExaQ+Eab1M681fgTXAxlt6cat5GtnRFIgKwaeBpb+vX5UNk3BRw6cfIlNaBQ OnStMLzSwt3vRlWh6YnyQ4OfgusBS5d9Sa91ohyvDSArB2W0J/u3ZxsIsUxKTsnz XQt+40hgVHOI7GSQfl0u4PqrC/hhRnU9d/iZFO/JcGuN8/+m9hAH328inKz1lMu3 ikEsnz7U6eS3nTM8bcw/x1otrNCBa55iOMqw09lq4hsGUs9c8JwWu/Tvl3WQ3DPa dkDXdgCs5rne4apqKJ5IOQXlBuM0nZg1z9sHNj0ANdzFlaBDfDLzG4WS4pXv04iq 4OsXNsqYVeLWq6LzbkZ9YkCZ4gag+Ycb8UpFGJJwoYj9WVbAU7AwjfhMfPpK3vpW 38YUU9/ERCm8Fbmgbn94pJ9MivO5/hdQU+vChBEJB1xvjKj79zWtYIQscbs1hMN9 vcuGDI770ZZ+ma02w3fbeuZKWF6BF8eyRjhuqG83StNsre9Px+Q= =Lq4u -----END PGP SIGNATURE----- --=-gVVni4qg9wr3Uxf42J6d--