From nobody Sat Aug 12 10:00:42 2023 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RNGQT62qzz4mJ7Q for ; Sat, 12 Aug 2023 10:01:21 +0000 (UTC) (envelope-from marietto2008@gmail.com) Received: from mail-ej1-x62f.google.com (mail-ej1-x62f.google.com [IPv6:2a00:1450:4864:20::62f]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RNGQS5f9rz4SZB for ; Sat, 12 Aug 2023 10:01:20 +0000 (UTC) (envelope-from marietto2008@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20221208 header.b=ShHP5v4t; spf=pass (mx1.freebsd.org: domain of marietto2008@gmail.com designates 2a00:1450:4864:20::62f as permitted sender) smtp.mailfrom=marietto2008@gmail.com; dmarc=pass (policy=none) header.from=gmail.com Received: by mail-ej1-x62f.google.com with SMTP id a640c23a62f3a-99357737980so372643966b.2 for ; Sat, 12 Aug 2023 03:01:20 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1691834479; x=1692439279; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=TraIWhW+QrGIsUDg0uHmAD3I2+MPBir1668p+/Qs6ew=; b=ShHP5v4t2PJ07IOFt0qcAqsZ6ZTMnjysvjbCT2DINgahJm81+2Dk/2P3GvXWmbodHP GIIuM+RWM31Yr1V3ld2mst6iLMsUNC6zOuMsBW0txa4jpff/XE8enDv3yqWU2ScofFz7 yKB2FtZ33uBOId1X2gxzybFxDI9X0y03NLYqZW8DOy2G0oTdKJtA2OYm9cdWDhTQp/xn hicllAmQ7zlu9rSxLDGY79EoJ7JnF3BIalyQ0QxTROISBxLNkaQx5k7y55zF/Rc5eHZs DyROm+j2Rw3N5a4ULzZngx3gYxTjM78vDhfkKn92490HDqs6rk/SqVOJ61OT4pC6rwyx KqzA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1691834479; x=1692439279; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=TraIWhW+QrGIsUDg0uHmAD3I2+MPBir1668p+/Qs6ew=; b=kUwt9Ftx/PUtVaVsQYYd6HF3fryK8rT+wmLUIgMmZM41c+MWYI/2fPuNpheHB535DA 5hH6wRVoNBdHNFeyIH5fmm3ZrGsJLhcGF/RFrda1aoc+JDs/vhDTIpVGt3OlBihLg4rW M7wNhU0MkVklWju5T6C7uQfD6FE3TXFjoH2YHjmLd2W6dnz+2EqEuGkJTdlBUdN74f0u L7Wd2mzhZlGmHCWLWfORMZ3+xzpgIU4GUhrN5AlyJsQkoNcGRcttAKYp78ttO72ZKBuw z/5leiZj4opwA/GFbIkGMUlLBtnEMQkQPW5XaRjw5dpv0C5WDpw/PHrhQl/VSrlnKbPv PqSA== X-Gm-Message-State: AOJu0YysbZrbwkw0AOabl34xg2nFZqBxrAfCKDAmYE1VzkbeTFaTdG+N wjozh7mH02yVvUYZDDFAq0Wojkvw00BVRdcVJrH86c1jqoau4Q== X-Google-Smtp-Source: AGHT+IEctCocdMtt1IbRod4jxNeK/THc/6x2odfizEfjFd4GsWVR8l0dYTc7KBNnnCXZm2NhTfbjxaEvID0oMIGn03U= X-Received: by 2002:a17:907:77c9:b0:982:1936:ad27 with SMTP id kz9-20020a17090777c900b009821936ad27mr3399481ejc.11.1691834478479; Sat, 12 Aug 2023 03:01:18 -0700 (PDT) List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Mario Marietto Date: Sat, 12 Aug 2023 12:00:42 +0200 Message-ID: Subject: Re: Starting the bhyve journey To: Odhiambo Washington Cc: freebsd-virtualization@freebsd.org Content-Type: multipart/alternative; boundary="0000000000001bd4ef0602b6e9cd" X-Spamd-Result: default: False [0.04 / 15.00]; URI_COUNT_ODD(1.00)[9]; HTTP_TO_IP(1.00)[]; NEURAL_SPAM_LONG(1.00)[0.997]; NEURAL_HAM_SHORT(-1.00)[-0.997]; NEURAL_HAM_MEDIUM(-0.96)[-0.963]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20221208]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; ARC_NA(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::62f:from]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; DKIM_TRACE(0.00)[gmail.com:+]; MID_RHS_MATCH_FROMTLD(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; RCVD_TLS_LAST(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; FREEMAIL_TO(0.00)[gmail.com]; RCVD_COUNT_ONE(0.00)[1]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FROM_EQ_ENVFROM(0.00)[]; MLMMJ_DEST(0.00)[freebsd-virtualization@freebsd.org] X-Spamd-Bar: / X-Rspamd-Queue-Id: 4RNGQS5f9rz4SZB --0000000000001bd4ef0602b6e9cd Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Try like this : bhyve -S -c sockets=3D2,cores=3D2,threads=3D2 -m 4G -w -H -A \ -s 0,hostbridge \ -s 1,ahci-hd,/mnt/zroot2/zroot2/bhyve/img/Windows/windows11.img,bootindex= =3D1 \ -s 13,virtio-net,tap1 \ -s 29,fbuf,tcp=3D0.0.0.0:5918,w=3D1600,h=3D950,wait \ -s 30,xhci,tablet \ -s 31,lpc \ -l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI_CODE.fd \ vm0:1 < /dev/null & sleep 2 && vncviewer 0:1 Doing this way you will learn better how to compose the bhyve parameters and how they should be formatted naturally. As you can see,the vm-bhyve wrapper "muddies the waters". And I think that you should also learn how to create a bridge on FreeBSD. On Sat, Aug 12, 2023 at 11:46=E2=80=AFAM Mario Marietto wrote: > In my opinion,the usage of the wrapper creates some difficulties to > understand how bhyve and the networking works. You should start from the > very beginning,studying bhyve and the freebsd networking,instead of > learning how to correctly use the wrapper. > > On Sat, Aug 12, 2023 at 11:25=E2=80=AFAM Odhiambo Washington > wrote: > >> Hello all. >> >> I am new to bhyve and have read a lot about it, so I decided to try >> creating a few VMs. >> I found a HOWTO that is detailed and which appears to be the easiest to >> follow: >> https://klarasystems.com/articles/from-0-to-bhyve-on-freebsd-13-1/ >> The only differences are that I did not install a fresh FreeBSD-13 serve= r >> as I already had one, and I am not using ZFS on my server (host). >> I have gotten stuck midway and cannot figure out why: I cannot boot the >> VMs I create. >> I have tried creating a Windows2019 as well as a Debian12 VM, but both >> don't boot. >> >> vm-public: flags=3D8843 metric 0 >> mtu 1492 >> ether ce:6f:18:51:d4:51 >> id 00:00:00:00:00:00 priority 32768 hellotime 2 fwddelay 15 >> maxage 20 holdcnt 6 proto rstp maxaddr 2000 timeout 1200 >> root id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0 >> member: em1 flags=3D143 >> ifmaxaddr 0 port 2 priority 128 path cost 20000 >> groups: bridge vm-switch viid-4c918@ >> nd6 options=3D9 >> tap0: flags=3D8943 metri= c 0 >> mtu 1492 >> description: vmnet/debian12/0/public >> options=3D80000 >> ether 58:9c:fc:10:ff:ed >> inet6 fe80::5a9c:fcff:fe10:ffed%tap0 prefixlen 64 scopeid 0x6 >> groups: tap vm-port >> media: Ethernet autoselect >> status: no carrier >> nd6 options=3D21 >> >> 1. Windows2019 VM: >> vm create -t uefi -s 100G -m 8G -c8 windows2019 >> vm install windows2019 /usr/local/bhyve-vms/.iso/server2019.iso >> >> 2. Debian12 VM: >> vm create -s 60G -m 8G -c 8 debian12 >> vm install debian12 .iso/debian-12.0.0-amd64-DVD-1.iso >> >> root@gw:/usr/local/bhyve-vms # vm list >> NAME DATASTORE LOADER CPU MEMORY VNC AUTO STATE >> debian12 default bhyveload 8 8G - >> Yes[2] Bootloader (91866) >> windows2019 default uefi 8 8G - >> Yes [1] Stopped >> >> From the above output of `vm list`, you can see that none of them is >> booting up. >> >> What is it that I could be missing? >> >> >> -- >> Best regards, >> Odhiambo WASHINGTON, >> Nairobi,KE >> +254 7 3200 0004/+254 7 2274 3223 >> "Oh, the cruft.", egrep -v '^$|^.*#' =C2=AF\_(=E3=83=84)_/=C2=AF :-) >> [How to ask smart questions: >> http://www.catb.org/~esr/faqs/smart-questions.html] >> > > > -- > Mario. > --=20 Mario. --0000000000001bd4ef0602b6e9cd Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable 
Try like=
 this :

bhyve -S -c sockets=3D2,cores=3D2,threads=3D2 -m 4G -w -H -A=
 \
-s 0,hostbridge \
-s 1,ahci-hd,/mnt/zroot2/zroot2/bhyve/img/Windows/windows11.img,bootindex=
=3D1 \
-s 13,virtio-net,tap1 \
-s 29,fbuf,tcp=3D0.0.0.0:5918,w=3D1600,=
h=3D950,wait \
-s 30,xhci,tablet \
-s 31,lpc \
-l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI_CODE.fd \
vm0:1 < /dev/null & sleep 2 && vncviewer 0:1

<=
/pre>
Doing this way you will learn be=
tter how to compose the bhyve parameters and how they should be formatted n=
aturally. 
As you can see,the vm-bhyve wrapper "muddies the waters". And I think that yo=
u should also learn how to create a bridge on FreeBSD.
On Sat, = Aug 12, 2023 at 11:46=E2=80=AFAM Mario Marietto <marietto2008@gmail.com> wrote:
In my opinion,the= usage of the wrapper creates some difficulties to understand how bhyve and= the networking works. You should start from the very beginning,studying bh= yve and the freebsd networking,instead of learning how to correctly use the= wrapper.

On Sat, Aug 12, 2023 at 11:25=E2=80=AFAM Odhiambo Washington &= lt;odhiambo@gmail.c= om> wrote:
Hello all.

I am new to bhyve and have= read a lot about it, so I decided to try creating a few VMs.
I f= ound a HOWTO that is detailed and which appears to be the easiest to follow= :=C2=A0https://klarasystems.com/articles/from-0-to-bh= yve-on-freebsd-13-1/
The only differences are that I did not = install a fresh FreeBSD-13 server as I already had one, and I am not using = ZFS on my server (host).
I have gotten stuck midway and cannot fi= gure out why: I cannot boot the VMs I create.
I have tried creati= ng a Windows2019 as well as a Debian12 VM, but both don't boot.

vm-public: flags=3D8843<UP,BROADCAST,RUNNING,SIMPLEX,M= ULTICAST> metric 0 mtu 1492
=C2=A0 =C2=A0 =C2=A0 =C2=A0 ether ce:6f:1= 8:51:d4:51
=C2=A0 =C2=A0 =C2=A0 =C2=A0 id 00:00:00:00:00:00 priority 327= 68 hellotime 2 fwddelay 15
=C2=A0 =C2=A0 =C2=A0 =C2=A0 maxage 20 holdcnt= 6 proto rstp maxaddr 2000 timeout 1200
=C2=A0 =C2=A0 =C2=A0 =C2=A0 root= id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0
=C2=A0 =C2=A0 =C2= =A0 =C2=A0 member: em1 flags=3D143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>= ;
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 ifmaxaddr 0 po= rt 2 priority 128 path cost 20000
=C2=A0 =C2=A0 =C2=A0 =C2=A0 groups: br= idge vm-switch viid-4c918@
=C2=A0 =C2=A0 =C2=A0 =C2=A0 nd6 options=3D9&l= t;PERFORMNUD,IFDISABLED>
tap0: flags=3D8943<UP,BROADCAS= T,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1492
=C2=A0 =C2=A0 = =C2=A0 =C2=A0 description: vmnet/debian12/0/public
=C2=A0 =C2=A0 =C2=A0 = =C2=A0 options=3D80000<LINKSTATE>
=C2=A0 =C2=A0 =C2=A0 =C2=A0 ethe= r 58:9c:fc:10:ff:ed
=C2=A0 =C2=A0 =C2=A0 =C2=A0 inet6 fe80::5a9c:fcff:fe= 10:ffed%tap0 prefixlen 64 scopeid 0x6
=C2=A0 =C2=A0 =C2=A0 =C2=A0 groups= : tap vm-port
=C2=A0 =C2=A0 =C2=A0 =C2=A0 media: Ethernet autoselect
= =C2=A0 =C2=A0 =C2=A0 =C2=A0 status: no carrier
=C2=A0 =C2=A0 =C2=A0 =C2= =A0 nd6 options=3D21<PERFORMNUD,AUTO_LINKLOCAL>

1.=C2=A0 Windows2019 VM:
=C2=A0 =C2=A0 vm create -t uefi = -s 100G -m 8G -c8 windows2019
=C2=A0 =C2=A0=C2=A0vm install windo= ws2019 /usr/local/bhyve-vms/.iso/server2019.iso

2.= Debian12 VM:
=C2=A0 =C2=A0=C2=A0vm create -s 60G -m 8G -c 8 debi= an12
=C2=A0 =C2=A0=C2=A0vm install debian12 .iso/debian-12.0.0-am= d64-DVD-1.iso

root@gw:/usr/local/bhyve-vms # vm li= st
NAME =C2=A0 =C2=A0 =C2=A0 =C2=A0 DATASTORE =C2=A0LOADER =C2=A0 =C2=A0= CPU =C2=A0MEMORY =C2=A0VNC =C2=A0AUTO =C2=A0 =C2=A0 STATE
debian12 =C2= =A0 =C2=A0 default=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 bhyveload=C2=A0= =C2=A0 8=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A08G=C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0-=C2=A0 =C2=A0 =C2=A0 =C2=A0Yes[2]=C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0Bootloader (91866)
windows2019 =C2=A0default=C2=A0 =C2=A0 = =C2=A0 =C2=A0 uefi=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A08= =C2=A0 =C2=A0 =C2=A0 =C2=A0 8G=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0-=C2=A0 =C2=A0 =C2=A0 =C2=A0Yes [1]=C2=A0 =C2=A0 =C2=A0Stopped
=

From the above output of `vm list`, you can see that no= ne of them is booting up.

What is it that I could = be missing?


--
Best regards,
Odhiambo WASHINGTON,<= br>Nairobi,KE
+254 7 3200 0004/+254 7 2274 3223
"Oh, the cruft.&qu= ot;,=C2=A0egrep -v '^$|^.*#'= ;=C2=A0=C2=AF\_(=E3=83=84)_/=C2=AF=C2=A0:-)
[How to ask smart questions:=C2=A0http://www.catb.org/~esr/faqs/smart-questions.html]


--
Mario.


--
Mario.
--0000000000001bd4ef0602b6e9cd--