Skip site navigation (1)Skip section navigation (2)
Date:      Sun, 20 Mar 2022 23:11:29 +0100
From:      Mario Marietto <marietto2008@gmail.com>
To:        Chuck Tuffli <chuck@tuffli.net>
Cc:        jason@tubnor.net,  FreeBSD virtualization <freebsd-virtualization@freebsd.org>
Subject:   Re: bhyve NVMe 1.4 support
Message-ID:  <CA%2B1FSigP62M=jQp2ajcOSbFw3dGhyRr9RL2D8yhecT7Fp_oUgA@mail.gmail.com>
In-Reply-To: <CAM0tzX1aAVOjF4xjQKEjxU9Xo8Mdskd4bchVB=w6LE9m-=e0hg@mail.gmail.com>
References:  <CAM0tzX1W1Do=uqA3PONyksY4dmob%2BZMi-ib7aECVx6AH3XW6Pw@mail.gmail.com> <00bf01d80104$e6ba5de0$b42f19a0$@tubnor.net> <CAM0tzX1EdQfTDUMU1dNtQHxG9SB3VzNP5UGmHuiHCY5HsxL2QA@mail.gmail.com> <CAM0tzX1qJOuqJWv_04oMvTqQrmLNQf8O%2B8PJ6cjLyh9bLqRmNQ@mail.gmail.com> <082b01d80697$64e95030$2ebbf090$@tubnor.net> <CA%2B1FSiijy0YjX0Nju9kRAY8hsYc42Y70V3tu-RfqCnaRhzLa8A@mail.gmail.com> <CAM0tzX3SCOS2nOKaODVF2TCTOY_5F5sdqELA666uFRZ=ZreXpg@mail.gmail.com> <CA%2B1FSijNU7Nn9UZujU%2BCLgJkaYFrbfdu37RT7s_r%2Be08AMG0Pw@mail.gmail.com> <CAM0tzX03Sw23acPW8ZRcwXO2Rze12OuvBoO6QSUfePpfBdrbWA@mail.gmail.com> <CA%2B1FSijNKxNsHqHCTPE3swh_5ePc-_jtNHFtmBTbUbauEDPung@mail.gmail.com> <CAM0tzX3mG%2BmWvjXrR-5GzTN66y3=PpBqAT_6Gxddc5Kqwtm0qw@mail.gmail.com> <CA%2B1FSiiQKET%2BJqSdjo5py-sQgV4txM5QEBXCMA-98eN2Sjq8Gw@mail.gmail.com> <CAM0tzX1QhY1%2By5aM6LCUtK5LC1fRq=JF084LoP4gNMCHOsXKAg@mail.gmail.com> <CA%2B1FSiiMyP586_FCOi0cJNubWLYPpkFifuMkj=qNq6uGcaTk6A@mail.gmail.com> <CAM0tzX1aAVOjF4xjQKEjxU9Xo8Mdskd4bchVB=w6LE9m-=e0hg@mail.gmail.com>

next in thread | previous in thread | raw e-mail | index | archive | help
--000000000000865a0905daadab9d
Content-Type: text/plain; charset="UTF-8"

I'm running on FreeBSD 14 :

FreeBSD marietto 14.0-CURRENT FreeBSD 14.0-CURRENT #3
main-n253070-a30f71704ef: Thu Feb
10 12:33:57 CET 2022
marietto@marietto:/usr/obj/usr/src/amd64.amd64/sys/GENERIC
 a
md64

and I see the same exact problem :

root@marietto-BHYVE:~# fdisk -l

Disk /dev/nvme0n1: 931,51 GiB, 1000204886016 bytes, 1953525168 sectors
Disk model: bhyve-NVMe
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes

after having invoked bhyve like this :

bhyve -S -c sockets=2,cores=2,threads=2 -m 8G -w -H -A \
-s 0,hostbridge \
-s 1,virtio-blk,/mnt/$vmdisk'p2'/bhyve/os/Linux/impish-cuda-11-5-nvidia-495.img
\
-s 2,nvme,/dev/nvd0 \
-s 3,passthru,5/0/0 \
-s 4,passthru,1/0/0 \
-s 8,virtio-net,tap0 \
-s 9,virtio-9p,sharename=/ \
-s 29,fbuf,tcp=0.0.0.0:5900,w=1440,h=900 \
-s 30,xhci,tablet \
-s 31,lpc \
-l bootrom,/usr/local/share/uefi-firmware/BHYVE_BHF_CODE.fd \
vm0 < /dev/null & sleep 2 && vncviewer 0:0

anyway there is a difference between freebsd 13 and 14. On freebsd
13,adding this parameter on /etc/rc.conf :

hw.nvme.use_nvd=0

does not produce errors. But on FreeBSD 14,it says not found or something
like this.


Il giorno dom 20 mar 2022 alle ore 22:20 Chuck Tuffli <chuck@tuffli.net> ha
scritto:

> On Sun, Mar 20, 2022 at 1:38 PM Mario Marietto <marietto2008@gmail.com>
> wrote:
> >
> > FreeBSD 13.1-RELEASE is out ? Can I upgrade from 13-p8 to 13-1 with
> freebsd-update fetch / freebsd-update install ?
>
> RELEASE isn't out, but BETA2 is available. So,
> # freebsd-update upgrade -r 13.1-BETA2
> # freebsd-update install
>
> boot environments are your friend, etc :)
>


-- 
Mario.

--000000000000865a0905daadab9d
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div>I&#39;m running on FreeBSD 14 :</div><div><br></div><=
div><span style=3D"font-family:monospace"><span style=3D"color:rgb(0,0,0);b=
ackground-color:rgb(255,255,255)">FreeBSD marietto 14.0-CURRENT FreeBSD 14.=
0-CURRENT #3 main-n253070-a30f71704ef: Thu Feb</span><br> 10 12:33:57 CET 2=
022 =C2=A0=C2=A0=C2=A0=C2=A0marietto@marietto:/usr/obj/usr/src/amd64.amd64/=
sys/GENERIC =C2=A0a<br>md64</span></div><div><span style=3D"font-family:mon=
ospace"><br></span></div><div><span style=3D"font-family:monospace">and I s=
ee the same exact problem :</span></div><div><span style=3D"font-family:mon=
ospace"><br></span></div><div><span style=3D"font-family:monospace"><span s=
tyle=3D"font-family:monospace"><span style=3D"color:rgb(0,0,0);background-c=
olor:rgb(255,255,255)">root@marietto-BHYVE:~# fdisk -l
</span><br><span style=3D"font-weight:bold;color:rgb(0,0,0);background-colo=
r:rgb(255,255,255)"><br></span></span></span></div><div><span style=3D"font=
-family:monospace"><span style=3D"font-family:monospace"><span style=3D"fon=
t-weight:bold;color:rgb(0,0,0);background-color:rgb(255,255,255)"></span></=
span></span></div><div><span style=3D"font-family:monospace"><span style=3D=
"font-family:monospace"><span style=3D"font-weight:bold;color:rgb(0,0,0);ba=
ckground-color:rgb(255,255,255)">Disk /dev/nvme0n1: 931,51 GiB, 10002048860=
16 bytes, 1953525168 sectors</span><span style=3D"color:rgb(0,0,0);backgrou=
nd-color:rgb(255,255,255)">
</span><br>Disk model: bhyve-NVMe =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=
=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0<br>Units=
: sectors of 1 * 512 =3D 512 bytes
<br>Sector size (logical/physical): 512 bytes / 512 bytes
<br>I/O size (minimum/optimal): 512 bytes / 512 bytes<br>
<br></span></span></div><div><span style=3D"font-family:monospace"><span st=
yle=3D"font-family:monospace">after having invoked bhyve like this :</span>=
</span></div><div><span style=3D"font-family:monospace"><span style=3D"font=
-family:monospace"><br></span></span></div><div><pre dir=3D"ltr"><code><spa=
n><span>bhyve -S -c sockets=3D2,cores=3D2,threads=3D2 -m 8G -w -H -A \
-s 0,hostbridge \
-s 1,virtio-blk,/mnt/$vmdisk&#39;p2&#39;/bhyve/os/Linux/impish-cuda-11-</sp=
an></span>5-nvidia-495.img \
-s 2,nvme,/dev/nvd0 \
-s 3,passthru,5/0/0 \
-s 4,passthru,1/0/0 \
-s 8,virtio-net,tap0 \
-s 9,virtio-9p,sharename=3D/ \
-s 29,fbuf,tcp=3D<a href=3D"http://0.0.0.0:5900" target=3D"_blank">0.0.0.0:=
5900</a>,w=3D1440,h=3D900 \
-s 30,xhci,tablet \
-s 31,lpc \
-l bootrom,/usr/local/share/uefi-firmware/BHYVE_BHF_CODE.fd \
vm0 &lt; /dev/null &amp; sleep 2 &amp;&amp; vncviewer 0:0</code></pre><span=
 style=3D"font-family:monospace"><span style=3D"font-family:monospace"></sp=
an></span></div><div><span style=3D"font-family:monospace">anyway there is =
a difference between freebsd 13 and 14. On freebsd 13,adding this parameter=
 on /etc/rc.conf :<br></span></div><div><span style=3D"font-family:monospac=
e"><br></span></div><div><span style=3D"font-family:monospace"><span style=
=3D"font-family:monospace"><span style=3D"color:rgb(0,0,0);background-color=
:rgb(255,255,255)">hw.nvme.use_nvd=3D0</span><br></span></span></div><div><=
span style=3D"font-family:monospace"><span style=3D"font-family:monospace">=
<br></span></span></div><div><span style=3D"font-family:monospace"><span st=
yle=3D"font-family:monospace">does not produce errors. But on FreeBSD 14,it=
 says not found or something like this. <br></span></span></div><div><span =
style=3D"font-family:monospace"><span style=3D"font-family:monospace"><br><=
/span></span></div></div><br><div class=3D"gmail_quote"><div dir=3D"ltr" cl=
ass=3D"gmail_attr">Il giorno dom 20 mar 2022 alle ore 22:20 Chuck Tuffli &l=
t;<a href=3D"mailto:chuck@tuffli.net" target=3D"_blank">chuck@tuffli.net</a=
>&gt; ha scritto:<br></div><blockquote class=3D"gmail_quote" style=3D"margi=
n:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex=
">On Sun, Mar 20, 2022 at 1:38 PM Mario Marietto &lt;<a href=3D"mailto:mari=
etto2008@gmail.com" target=3D"_blank">marietto2008@gmail.com</a>&gt; wrote:=
<br>
&gt;<br>
&gt; FreeBSD 13.1-RELEASE is out ? Can I upgrade from 13-p8 to 13-1 with fr=
eebsd-update fetch / freebsd-update install ?<br>
<br>
RELEASE isn&#39;t out, but BETA2 is available. So,<br>
# freebsd-update upgrade -r 13.1-BETA2<br>
# freebsd-update install<br>
<br>
boot environments are your friend, etc :)<br>
</blockquote></div><br clear=3D"all"><br>-- <br><div dir=3D"ltr">Mario.<br>=
</div>

--000000000000865a0905daadab9d--



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CA%2B1FSigP62M=jQp2ajcOSbFw3dGhyRr9RL2D8yhecT7Fp_oUgA>