Date: Tue, 21 Mar 2023 11:59:50 -0500 From: Nikita Olenets <zeon@zeon.kiev.ua> To: Mario Marietto <marietto2008@gmail.com> Cc: =?UTF-8?Q?Julie_Koubov=C3=A1?= <julie@koubova.net>, Miroslav Lachman <000.fbsd@quip.cz>, freebsd-virtualization@freebsd.org Subject: Re: Bhyve process consumes way too much CPU Message-ID: <CAJ5wse0J%2BJm3KGHMyNSQO%2BApQCEva6o0meAW4xVf3rcKyT8ukA@mail.gmail.com> In-Reply-To: <CA%2B1FSij5XiJ9o1Sgh8S2-y31XtUJ=GLMo6q6p-w49peApcDM5w@mail.gmail.com> References: <CABQ-j0ZH-OrZSb866iVMba-ZfxOsovGoyLd=YZ=auOiNtm-TkA@mail.gmail.com> <CABQ-j0bbTQWhM1wgYvDvvwpxQexqgtYDgN4vj8pYp2Ttu_WHHg@mail.gmail.com> <343e827b-a1dc-b69b-9dcc-c6675deac070@quip.cz> <CA%2B1FSihrMf77N1Ec1wyndmvmJg5g6Ya9KJjKm9XcsM6o7R5V0g@mail.gmail.com> <CAJ5wse2Oyz%2B=P3ojNz8YqH79fKxJs7uOBzvMu7crkbxg_EykGQ@mail.gmail.com> <CA%2B1FSij5XiJ9o1Sgh8S2-y31XtUJ=GLMo6q6p-w49peApcDM5w@mail.gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
--00000000000067398d05f76bf971 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hey Mario, Yeah, sorry. I was thinking that you were the topic starter and you were trying to make things work under bhyve. Have a goo day. =E2=80=94 Nikita On Tue, Mar 21, 2023 at 12:54 Mario Marietto <marietto2008@gmail.com> wrote= : > Are you talking with me ? I can install Home Assistant only on the > hardware that I already have. Actually the best piece of hardware that I > can use for my project (installing the chat gpt module on Home Assistant = + > a speech recognition software to give a voice to chat gpt) is the nvidia > jetson nano. And If I remember correctly,it supports only Ubuntu. I can d= o > the same on my Workstation,but I prefer to have the ability to move the > smaller nano within a plastic container. At the end of the day It will be > almost the same as a vocal assistant,but uch more programmable. > > On Tue, Mar 21, 2023 at 5:41=E2=80=AFPM Nikita Olenets <zeon@zeon.kiev.ua= > wrote: > >> Hi, >> >> Is there any specific reason you want it to be installed under Ubuntu? >> I=E2=80=99m asking this because I use HasOS(home assistant OS) which is = based on >> Linux (can=E2=80=99t recall the distribution) and I=E2=80=99m running th= is for three years >> now. No issues at all. I do have even passed through ZigBee usb stick an= d >> it works just fine. >> >> On Mon, Mar 20, 2023 at 11:12 Mario Marietto <marietto2008@gmail.com> >> wrote: >> >>> Hello Julie. >>> >>> As I said some days ago,I'm trying to install homeassistant. For the >>> moment I'm using Ubuntu 20.04 that I have installed on the Jetson nano,= but >>> later I will use Ubuntu within bhyve on FreeBSD. Unfortunately,a >>> developer,I suppose,told me that homeassistant is not supported on ubun= tu. >>> In Fact I tried to do that following this tutorial : >>> >>> https://vikoky.medium.com/jetson-nano-powered-house-29ce73f11de4 >>> >>> but I've got a lot of errors. I've started a thread on reddit,asking fo= r >>> help,here : >>> >>> >>> https://www.reddit.com/r/homeassistant/comments/11wglx7/homeassisant_ca= nt_be_installed_on_ubuntu_2004_the/ >>> >>> and he/she told me that ubuntu is not supported. So,which linux >>> distribution have you used within bhyve ? thanks. >>> >>> On Sun, Mar 19, 2023 at 7:12=E2=80=AFPM Miroslav Lachman <000.fbsd@quip= .cz> >>> wrote: >>> >>>> On 18/03/2023 14:59, Julie Koubov=C3=A1 wrote: >>>> > Hey everyone, >>>> > >>>> > I'm running Linux (Home Assistant OS) in Bhyve on FreeBSD 13.1. I us= e >>>> > PCI passthrough to allow the VM to access a USB card with a couple o= f >>>> > radio dongles. The host machine is an Intel Core i3 13100 with 64 GB >>>> of >>>> > RAM. The CPU has 4 physical cores (8 hyper-threaded). The virtual >>>> > machine is assigned four cores. >>>> > >>>> > The host load averages are 0.39 0.39 0.40 right now, which seems way >>>> too >>>> > much. The same workload was previously handled by a Raspberry Pi 4, >>>> and >>>> > the CPU usage there was under 10% when not doing anything special. >>>> > Inside the guest OS, the CPU usage is reported around 5%, which seem= s >>>> > reasonable. >>>> > >>>> > What's wrong? How can I start debugging this issue? I use ZFS on the >>>> > host, vm-bhyve to manage the virtual machines, and I don't have a >>>> swap >>>> > partition. >>>> >>>> I had similar problem few years ago. Never solved. Exhibited on bhyve >>>> and VirtualBox too. The problem was "the more vCPU for VM, the slower >>>> VM". >>>> Can you try to set just 1 vCPU to your VM? In my case, VM with 1 vCPU >>>> was fast, almost no overhead, 2 v CPUs slightly slower but 4 or more >>>> was >>>> slow as hell. >>>> I would also recommend not to overprovision real CPU core count to vCP= U >>>> and not use multi/hyper threading cores as real cores. With your CPU, >>>> use only 4 cores to assign to all your VMs (4 VMs with 1 vCPU each, or >>>> 2 >>>> VMs with 2 vCPU each, 1 VM with 4 vCPU) >>>> >>>> Miroslav Lachman >>>> >>>> >>>> >>> >>> -- >>> Mario. >>> >> -- >> Nikita Olenets >> >> > > -- > Mario. > --=20 Nikita Olenets --00000000000067398d05f76bf971 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable <div dir=3D"auto">Hey Mario,</div><div dir=3D"auto"><br></div><div dir=3D"a= uto">Yeah, sorry. I was thinking that you were the topic starter and you we= re trying to make things work under bhyve.</div><div dir=3D"auto"><br></div= ><div dir=3D"auto">Have a goo day.</div><div dir=3D"auto"><br></div><div di= r=3D"auto">=E2=80=94 Nikita</div><div><br><div class=3D"gmail_quote"><div d= ir=3D"ltr" class=3D"gmail_attr">On Tue, Mar 21, 2023 at 12:54 Mario Mariett= o <<a href=3D"mailto:marietto2008@gmail.com">marietto2008@gmail.com</a>&= gt; wrote:<br></div><blockquote class=3D"gmail_quote" style=3D"margin:0 0 0= .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir=3D"ltr">Are you= talking with me ? I can install Home Assistant only on the hardware that I= already have. Actually the best piece of hardware that I can use for my pr= oject (installing the chat gpt module on Home Assistant + a speech recognit= ion software to give a voice to chat gpt) is the nvidia jetson nano. And If= I remember correctly,it supports only Ubuntu. I can do the same on my Work= station,but I prefer to have the ability to move the smaller nano within a = plastic container. At the end of the day It will be almost the same as a vo= cal assistant,but uch more programmable. <br></div><br><div class=3D"gmail_= quote"><div dir=3D"ltr" class=3D"gmail_attr">On Tue, Mar 21, 2023 at 5:41= =E2=80=AFPM Nikita Olenets <<a href=3D"mailto:zeon@zeon.kiev.ua" target= =3D"_blank">zeon@zeon.kiev.ua</a>> wrote:<br></div><blockquote class=3D"= gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(20= 4,204,204);padding-left:1ex"><div dir=3D"auto">Hi,</div><div dir=3D"auto"><= br></div><div dir=3D"auto">Is there any specific reason you want it to be i= nstalled under Ubuntu?</div><div dir=3D"auto">I=E2=80=99m asking this becau= se I use HasOS(home assistant OS) which is based on Linux (can=E2=80=99t re= call the distribution) and I=E2=80=99m running this for three=C2=A0years no= w. No issues at all. I do have even passed through ZigBee usb stick and it = works just fine.</div><div dir=3D"auto"><br></div><div><div class=3D"gmail_= quote"><div dir=3D"ltr" class=3D"gmail_attr">On Mon, Mar 20, 2023 at 11:12 = Mario Marietto <<a href=3D"mailto:marietto2008@gmail.com" target=3D"_bla= nk">marietto2008@gmail.com</a>> wrote:<br></div><blockquote class=3D"gma= il_quote" style=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,2= 04,204);padding-left:1ex"><div dir=3D"ltr"><div>Hello Julie.</div><div><br>= </div><div>As I said some days ago,I'm trying to install homeassistant.= For the moment I'm using Ubuntu 20.04 that I have installed on the Jet= son nano,but later I will use Ubuntu within bhyve on FreeBSD. Unfortunately= ,a developer,I suppose,told me that homeassistant is not supported on ubunt= u. In Fact I tried to do that following this tutorial :</div><div><br></div= ><div><a href=3D"https://vikoky.medium.com/jetson-nano-powered-house-29ce73= f11de4" target=3D"_blank">https://vikoky.medium.com/jetson-nano-powered-hou= se-29ce73f11de4</a></div><div><br></div><div>but I've got a lot of erro= rs. I've started a thread on reddit,asking for help,here :</div><div><b= r></div><div><a href=3D"https://www.reddit.com/r/homeassistant/comments/11w= glx7/homeassisant_cant_be_installed_on_ubuntu_2004_the/" target=3D"_blank">= https://www.reddit.com/r/homeassistant/comments/11wglx7/homeassisant_cant_b= e_installed_on_ubuntu_2004_the/</a></div><div><br></div><div>and he/she tol= d me that ubuntu is not supported. So,which linux distribution have you use= d within bhyve ? thanks.<br></div></div><br><div class=3D"gmail_quote"><div= dir=3D"ltr" class=3D"gmail_attr">On Sun, Mar 19, 2023 at 7:12=E2=80=AFPM M= iroslav Lachman <<a href=3D"mailto:000.fbsd@quip.cz" target=3D"_blank">0= 00.fbsd@quip.cz</a>> wrote:<br></div><blockquote class=3D"gmail_quote" s= tyle=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);pad= ding-left:1ex">On 18/03/2023 14:59, Julie Koubov=C3=A1 wrote:<br> > Hey everyone,<br> > <br> > I'm running Linux (Home Assistant OS) in Bhyve on FreeBSD 13.1. I = use <br> > PCI passthrough to allow the VM to=C2=A0access a USB card with a coupl= e of <br> > radio dongles. The host machine is an Intel Core i3 13100 with 64 GB o= f <br> > RAM. The CPU has 4 physical cores (8 hyper-threaded). The virtual <br> > machine is assigned four cores.<br> > <br> > The host load averages are 0.39 0.39 0.40 right now, which seems way t= oo <br> > much. The same workload was previously handled by a Raspberry Pi 4, an= d <br> > the CPU usage there was under 10% when not doing anything special. <br= > > Inside the guest OS, the CPU usage is reported around 5%, which seems = <br> > reasonable.<br> > <br> > What's wrong? How can I start debugging this issue? I use ZFS on t= he <br> > host, vm-bhyve to manage the virtual machines, and I don't have a = swap <br> > partition.<br> <br> I had similar problem few years ago. Never solved. Exhibited on bhyve <br> and VirtualBox too. The problem was "the more vCPU for VM, the slower = VM".<br> Can you try to set just 1 vCPU to your VM? In my case, VM with 1 vCPU <br> was fast, almost no overhead, 2 v CPUs slightly slower but 4 or more was <b= r> slow as hell.<br> I would also recommend not to overprovision real CPU core count to vCPU <br= > and not use multi/hyper threading cores as real cores. With your CPU, <br> use only 4 cores to assign to all your VMs (4 VMs with 1 vCPU each, or 2 <b= r> VMs with 2 vCPU each, 1 VM with 4 vCPU)<br> <br> Miroslav Lachman<br> <br> <br> </blockquote></div><br clear=3D"all"><br><span>-- </span><br><div dir=3D"lt= r">Mario.<br></div> </blockquote></div></div>-- <br><div dir=3D"ltr"><div dir=3D"ltr"><div>Niki= ta Olenets<br><br></div></div></div> </blockquote></div><br clear=3D"all"><br><span>-- </span><br><div dir=3D"lt= r">Mario.<br></div> </blockquote></div></div>-- <br><div dir=3D"ltr" class=3D"gmail_signature" = data-smartmail=3D"gmail_signature"><div dir=3D"ltr"><div>Nikita Olenets<br>= <br></div></div></div> --00000000000067398d05f76bf971--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAJ5wse0J%2BJm3KGHMyNSQO%2BApQCEva6o0meAW4xVf3rcKyT8ukA>