Skip site navigation (1)Skip section navigation (2)
Date:      Tue, 8 Feb 2022 17:20:00 +0100
From:      Mario Marietto <marietto2008@gmail.com>
To:        FreeBSD virtualization <freebsd-virtualization@freebsd.org>
Subject:   Multiple bugs on bhyve present on FreeBSD 13R p7 while passing thru USB controller and graphic card
Message-ID:  <CA%2B1FSigMNsuGGAqi7hQZTuAFzMuByKtcFs554SVs6oXrfUZs-g@mail.gmail.com>

next in thread | raw e-mail | index | archive | help
--000000000000e842dc05d78418e8
Content-Type: text/plain; charset="UTF-8"

Hello to everyone.

I'm using bhyve on FreeBSD 13R p7 and I'm trying to pass thru my usb
controller and / or my graphic card while at the same time I'm trying to
boot 3 operating systems (Ubuntu,Windows and FreeBSD 13) installed on a
SATA and / or NVME disk using the virtio-blk driver and the ahci-hd driver.
The problems that come out from this setup are different and concatenated.
Anyway,those OS won't boot because it seems that the devices that I pass
thru interferes with the booting process. If I don't pass thru any
device,they can boot properly. In addition,my graphic card (geforce 2080
ti) seems to have an additional problem. It seems that it is not passed
correctly.

CASE 0) Without passing thru the usb controller and the graphic card ubuntu
or windows 11 can boot properly with these parameters :

bhyve -S -c sockets=1,cores=2,threads=2 -m 4G -w -H \
-s 0,hostbridge \
-s 1,ahci-hd,/dev/nvd0 \
-s 8,virtio-net,tap1 \
-s 29,fbuf,tcp=0.0.0.0:5901,w=1440,h=900,wait \
-s 30,xhci,tablet \
-s 31,lpc \
-l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd \
-l com1,stdio \
vm1

BdsDxe: loading Boot0001 "UEFI BHYVE SATA DISK BHYVE-51F3-061F-A385" from
PciRoot(0x0)/Pci(0x1,0x0)/Sata(0x0,0
xFFFF,0x0)
BdsDxe: starting Boot0001 "UEFI BHYVE SATA DISK BHYVE-51F3-061F-A385" from
PciRoot(0x0)/Pci(0x1,0x0)/Sata(0x0,
0xFFFF,0x0)

CASE 1) Passing thru the usb controller and the graphic card and booting
from a physical installation of Linux or Windows 11 on a nvme disk :

bhyve -S -c sockets=1,cores=2,threads=2 -m 4G -w -H \
-s 0,hostbridge \
-s 1,ahci-hd,/dev/nvd0 \
-s 2,passthru,1/0/0 \
-s 3:0,passthru,2/0/0 \
-s 3:1,passthru,2/0/1 \
-s 3:2,passthru,2/0/2 \
-s 3:3,passthru,2/0/3 \
-s 8,virtio-net,tap1 \
-s 29,fbuf,tcp=0.0.0.0:5901,w=1440,h=900,wait \
-s 30,xhci,tablet \
-s 31,lpc \
-l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd \
-l com1,stdio \
vm1

Sometimes Assertion failed: (error == 0), function modify_bar_registration,
file /usr/src/usr.sbin/bhyve/pci_emul.c, line 501: Abort / sometimes black
screen frozen

CASE 2) Passing thru the usb controller and booting from a physical
installation of Linux or Windows 11 on a nvme disk :

bhyve -S -c sockets=1,cores=2,threads=2 -m 4G -w -H \
-s 0,hostbridge \
-s 1,ahci-hd,/dev/nvd0 \
-s 2,passthru,1/0/0 \
-s 8,virtio-net,tap1 \
-s 29,fbuf,tcp=0.0.0.0:5901,w=1440,h=900,wait \
-s 30,xhci,tablet \
-s 31,lpc \
-l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd \
-l com1,stdio \
vm1

= BdsDxe: failed to load Boot0001 "UEFI BHYVE SATA DISK
BHYVE-51F3-061F-A385" from PciRoot(0x0)/Pci(0x1,0x0)/Sat
a(0x0,0xFFFF,0x0): Not Found

CASE 3) Passing thru the graphic card and booting from a physical
installation of Linux or Windows 11 on a nvme disk :

bhyve -S -c sockets=1,cores=2,threads=2 -m 4G -w -H \
-s 0,hostbridge \
-s 1,ahci-hd,/dev/nvd0 \
-s 2:0,passthru,2/0/0 \
-s 2:1,passthru,2/0/1 \
-s 2:2,passthru,2/0/2 \
-s 2:3,passthru,2/0/3 \
-s 8,virtio-net,tap1 \
-s 29,fbuf,tcp=0.0.0.0:5901,w=1440,h=900,wait \
-s 30,xhci,tablet \
-s 31,lpc \
-l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd \
-l com1,stdio \
vm1

= Assertion failed: (error == 0), function modify_bar_registration, file
/usr/src/usr.sbin/bhyve/pci_emul.c, line 501 : Abort

I've tried with virtio-blk instead of ahci-hd and with /dev/ada2 (sata
disk) instead of the nvdm disk and nothing is changed. now,explain to me
how should I make the bug report. I'm not sure,since I see two different or
more bugs concatenated but I haven't the competence to report them
separately. Would be better if you do it for me and then give me the links
of the bugs,so I learn something more.

-- 
Mario.

--000000000000e842dc05d78418e8
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div><div>Hello to everyone.</div><div><br></div><div>I&#3=
9;m using bhyve on FreeBSD 13R p7 and I&#39;m trying to pass thru my usb co=
ntroller and / or my graphic card while at the same time I&#39;m trying to =
boot 3 operating systems (Ubuntu,Windows and FreeBSD 13) installed on a SAT=
A and / or NVME disk using the virtio-blk driver and the ahci-hd driver. Th=
e problems that come out from this setup are different and concatenated. An=
yway,those OS won&#39;t boot because it seems that the devices that I pass =
thru interferes with the booting process. If I don&#39;t pass thru any devi=
ce,they can boot properly. In addition,my graphic card (geforce 2080 ti) se=
ems to have an additional problem. It seems that it is not passed correctly=
. <br></div><div><br></div><div>CASE 0) Without passing thru the usb contro=
ller and the=20
graphic card ubuntu or windows 11 can boot properly with these=20
parameters :<br><div><br><span style=3D"font-family:monospace"><span style=
=3D"color:rgb(0,0,0);background-color:rgb(255,255,255)">bhyve -S -c sockets=
=3D1,cores=3D2,threads=3D2 -m 4G -w -H \
</span><br>-s 0,hostbridge \
<br>-s 1,ahci-hd,/dev/nvd0 \
<br>-s 8,virtio-net,tap1 \
<br></span></div><span class=3D"gmail-im"><div><span style=3D"font-family:m=
onospace"><span style=3D"font-family:monospace">-s 29,fbuf,tcp=3D<a href=3D=
"http://0.0.0.0:5901" target=3D"_blank">0.0.0.0:5901</a>,w=3D1440,h=3D900,w=
ait \
</span></span></div><div><span style=3D"font-family:monospace">-s 30,xhci,t=
ablet \
<br>-s 31,lpc \
<br>-l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd \
<br>-l com1,stdio \
<br>vm1<br></span></div><div><span style=3D"font-family:monospace"><br>
</span></div></span></div><span class=3D"gmail-im"><div><span style=3D"font=
-family:monospace"><span style=3D"font-family:monospace"><span style=3D"col=
or:rgb(0,0,0);background-color:rgb(255,255,255)">BdsDxe: loading Boot0001 &=
quot;UEFI BHYVE SATA DISK BHYVE-51F3-061F-A385&quot; from PciRoot(0x0)/Pci(=
0x1,0x0)/Sata(0x0,0</span><br>xFFFF,0x0)
<br>BdsDxe: starting Boot0001 &quot;UEFI BHYVE SATA DISK BHYVE-51F3-061F-A3=
85&quot; from PciRoot(0x0)/Pci(0x1,0x0)/Sata(0x0,<br>0xFFFF,0x0) <br></span=
></span></div><div><span style=3D"font-family:monospace"><span style=3D"fon=
t-family:monospace"><br></span></span></div></span></div><div><div>CASE 1) =
<span style=3D"font-family:monospace"><span style=3D"color:rgb(0,0,0);backg=
round-color:rgb(255,255,255)">Passing
 thru the usb controller and the graphic card and booting from a=20
physical installation of Linux or Windows 11 on a nvme disk :<br></span></s=
pan></div><div><span style=3D"font-family:monospace"><span style=3D"color:r=
gb(0,0,0);background-color:rgb(255,255,255)"><br></span></span></div><div><=
span style=3D"font-family:monospace"><span style=3D"color:rgb(0,0,0);backgr=
ound-color:rgb(255,255,255)">bhyve -S -c sockets=3D1,cores=3D2,threads=3D2 =
-m 4G -w -H \
</span><br><span class=3D"gmail-im">-s 0,hostbridge \
<br>-s 1,ahci-hd,/dev/nvd0 \
<br>-s 2,passthru,1/0/0 \
<br></span>-s 3:0,passthru,2/0/0 \
<br><span class=3D"gmail-im">-s 3:1,passthru,2/0/1 \
<br>-s 3:2,passthru,2/0/2 \
<br>-s 3:3,passthru,2/0/3 \
<br>-s 8,virtio-net,tap1 \
<br></span></span></div><span class=3D"gmail-im"><div><span style=3D"font-f=
amily:monospace"><span style=3D"font-family:monospace">-s 29,fbuf,tcp=3D<a =
href=3D"http://0.0.0.0:5901" target=3D"_blank">0.0.0.0:5901</a>,w=3D1440,h=
=3D900,wait \
</span></span></div><div><span style=3D"font-family:monospace">-s 30,xhci,t=
ablet \
<br>-s 31,lpc \
<br>-l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd \
<br>-l com1,stdio \
<br>vm1</span></div></span><div><div><div><span style=3D"font-family:monosp=
ace"><br></span></div><div><span style=3D"font-family:monospace"><span styl=
e=3D"color:rgb(0,0,0);background-color:rgb(255,255,255)">Sometimes Assertio=
n failed: (error =3D=3D 0), function modify_bar_registration, file /usr/src=
/usr.sbin/bhyve/pci_emul.c, lin</span>e 501: Abort / sometimes black screen=
 frozen<br>
</span></div><div><span style=3D"font-family:monospace"><br></span></div><s=
pan style=3D"font-family:monospace"></span></div><div><span style=3D"font-f=
amily:monospace">CASE 2) <span style=3D"font-family:monospace"><span style=
=3D"color:rgb(0,0,0);background-color:rgb(255,255,255)">Passing thru the us=
b controller and booting from a physical installation of Linux or Windows 1=
1 on a nvme disk :</span></span></span></div><div><span style=3D"font-famil=
y:monospace"><br></span></div><div><span style=3D"font-family:monospace"><s=
pan style=3D"font-family:monospace"><span style=3D"color:rgb(0,0,0);backgro=
und-color:rgb(255,255,255)">bhyve -S -c sockets=3D1,cores=3D2,threads=3D2 -=
m 4G -w -H \
</span><br><span class=3D"gmail-im">-s 0,hostbridge \
<br>-s 1,ahci-hd,/dev/nvd0 \
<br><span style=3D"font-family:monospace">-s 2,passthru,1/0/0 \
</span><br>-s 8,virtio-net,tap1 \
<br></span></span></span></div><span class=3D"gmail-im"><div><span style=3D=
"font-family:monospace"><span style=3D"font-family:monospace"><span style=
=3D"font-family:monospace"><span style=3D"font-family:monospace">-s 29,fbuf=
,tcp=3D<a href=3D"http://0.0.0.0:5901" target=3D"_blank">0.0.0.0:5901</a>,w=
=3D1440,h=3D900,wait \=C2=A0 </span></span><br>-s 30,xhci,tablet \
<br>-s 31,lpc \
<br>-l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd \
<br>-l com1,stdio \
<br>vm1</span></span></div><span style=3D"font-family:monospace"></span></s=
pan></div><span class=3D"gmail-im"><div><span style=3D"font-family:monospac=
e"><span style=3D"font-family:monospace"><span style=3D"font-family:monospa=
ce"><br></span></span></span></div><div><span style=3D"font-family:monospac=
e"><span style=3D"font-family:monospace"><span style=3D"font-family:monospa=
ce">=3D <span style=3D"font-family:monospace"><span style=3D"color:rgb(0,0,=
0);background-color:rgb(255,255,255)">BdsDxe: failed to load Boot0001 &quot=
;UEFI BHYVE SATA DISK BHYVE-51F3-061F-A385&quot; from PciRoot(0x0)/Pci(0x1,=
0x0)/Sat</span><br>a(0x0,0xFFFF,0x0): Not Found</span></span></span></span>=
</div><div><span style=3D"font-family:monospace"><span style=3D"font-family=
:monospace"><span style=3D"font-family:monospace"><span style=3D"font-famil=
y:monospace"><br></span></span></span></span></div></span><div><div><span s=
tyle=3D"font-family:monospace"><span style=3D"font-family:monospace"><span =
style=3D"font-family:monospace">CASE 3) <span style=3D"font-family:monospac=
e"><span style=3D"font-family:monospace"><span style=3D"color:rgb(0,0,0);ba=
ckground-color:rgb(255,255,255)">Passing thru the graphic card and booting =
from a physical installation of Linux or Windows 11 on a nvme disk :</span>=
</span></span></span></span></span></div><div><span style=3D"font-family:mo=
nospace"><span style=3D"font-family:monospace"><span style=3D"font-family:m=
onospace"><br></span></span></span></div><div><div><span style=3D"font-fami=
ly:monospace"><span style=3D"font-family:monospace"><span style=3D"color:rg=
b(0,0,0);background-color:rgb(255,255,255)">bhyve -S -c sockets=3D1,cores=
=3D2,threads=3D2 -m 4G -w -H \
</span><br>-s 0,hostbridge \
<br>-s 1,ahci-hd,/dev/nvd0 \
<br><span style=3D"font-family:monospace">-s 2:0,passthru,2/0/0 \
<br><span class=3D"gmail-im">-s 2:1,passthru,2/0/1 \
<br>-s 2:2,passthru,2/0/2 \
<br>-s 2:3,passthru,2/0/3 \
</span></span><br>-s 8,virtio-net,tap1 \
<br></span></span></div><span class=3D"gmail-im"><div><span style=3D"font-f=
amily:monospace"><span style=3D"font-family:monospace"><span style=3D"font-=
family:monospace"><span style=3D"font-family:monospace">-s 29,fbuf,tcp=3D<a=
 href=3D"http://0.0.0.0:5901" target=3D"_blank">0.0.0.0:5901</a>,w=3D1440,h=
=3D900,wait \=C2=A0 </span></span><br>-s 30,xhci,tablet \
<br>-s 31,lpc \
<br>-l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd \
<br>-l com1,stdio \
<br>vm1</span></span></div><div><span style=3D"font-family:monospace"><span=
 style=3D"font-family:monospace"><br>=3D <span style=3D"font-family:monospa=
ce"><span style=3D"color:rgb(0,0,0);background-color:rgb(255,255,255)">Asse=
rtion failed: (error =3D=3D 0), function modify_bar_registration, file /usr=
/src/usr.sbin/bhyve/pci_emul.c, lin</span>e 501 : Abort</span></span></span=
></div></span></div></div></div><div><br></div><div>I&#39;ve tried with vir=
tio-blk instead of ahci-hd and with /dev/ada2=20
(sata disk) instead of the nvdm disk and nothing is changed. now,explain
 to me how should I make the bug report. I&#39;m not sure,since I see two=
=20
different or more bugs concatenated but I haven&#39;t the competence to=20
report them separately. Would be better if you do it for me and then=20
give me the links of the bugs,so I learn something more. </div><br>-- <br><=
div dir=3D"ltr" class=3D"gmail_signature" data-smartmail=3D"gmail_signature=
">Mario.<br></div></div>

--000000000000e842dc05d78418e8--



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CA%2B1FSigMNsuGGAqi7hQZTuAFzMuByKtcFs554SVs6oXrfUZs-g>