Date: Tue, 21 Mar 2023 11:59:50 -0500 From: Nikita Olenets <zeon@zeon.kiev.ua> To: Mario Marietto <marietto2008@gmail.com> Cc: =?UTF-8?Q?Julie_Koubov=C3=A1?= <julie@koubova.net>, Miroslav Lachman <000.fbsd@quip.cz>, freebsd-virtualization@freebsd.org Subject: Re: Bhyve process consumes way too much CPU Message-ID: <CAJ5wse0J%2BJm3KGHMyNSQO%2BApQCEva6o0meAW4xVf3rcKyT8ukA@mail.gmail.com> In-Reply-To: <CA%2B1FSij5XiJ9o1Sgh8S2-y31XtUJ=GLMo6q6p-w49peApcDM5w@mail.gmail.com> References: <CABQ-j0ZH-OrZSb866iVMba-ZfxOsovGoyLd=YZ=auOiNtm-TkA@mail.gmail.com> <CABQ-j0bbTQWhM1wgYvDvvwpxQexqgtYDgN4vj8pYp2Ttu_WHHg@mail.gmail.com> <343e827b-a1dc-b69b-9dcc-c6675deac070@quip.cz> <CA%2B1FSihrMf77N1Ec1wyndmvmJg5g6Ya9KJjKm9XcsM6o7R5V0g@mail.gmail.com> <CAJ5wse2Oyz%2B=P3ojNz8YqH79fKxJs7uOBzvMu7crkbxg_EykGQ@mail.gmail.com> <CA%2B1FSij5XiJ9o1Sgh8S2-y31XtUJ=GLMo6q6p-w49peApcDM5w@mail.gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
[-- Attachment #1 --] Hey Mario, Yeah, sorry. I was thinking that you were the topic starter and you were trying to make things work under bhyve. Have a goo day. — Nikita On Tue, Mar 21, 2023 at 12:54 Mario Marietto <marietto2008@gmail.com> wrote: > Are you talking with me ? I can install Home Assistant only on the > hardware that I already have. Actually the best piece of hardware that I > can use for my project (installing the chat gpt module on Home Assistant + > a speech recognition software to give a voice to chat gpt) is the nvidia > jetson nano. And If I remember correctly,it supports only Ubuntu. I can do > the same on my Workstation,but I prefer to have the ability to move the > smaller nano within a plastic container. At the end of the day It will be > almost the same as a vocal assistant,but uch more programmable. > > On Tue, Mar 21, 2023 at 5:41 PM Nikita Olenets <zeon@zeon.kiev.ua> wrote: > >> Hi, >> >> Is there any specific reason you want it to be installed under Ubuntu? >> I’m asking this because I use HasOS(home assistant OS) which is based on >> Linux (can’t recall the distribution) and I’m running this for three years >> now. No issues at all. I do have even passed through ZigBee usb stick and >> it works just fine. >> >> On Mon, Mar 20, 2023 at 11:12 Mario Marietto <marietto2008@gmail.com> >> wrote: >> >>> Hello Julie. >>> >>> As I said some days ago,I'm trying to install homeassistant. For the >>> moment I'm using Ubuntu 20.04 that I have installed on the Jetson nano,but >>> later I will use Ubuntu within bhyve on FreeBSD. Unfortunately,a >>> developer,I suppose,told me that homeassistant is not supported on ubuntu. >>> In Fact I tried to do that following this tutorial : >>> >>> https://vikoky.medium.com/jetson-nano-powered-house-29ce73f11de4 >>> >>> but I've got a lot of errors. I've started a thread on reddit,asking for >>> help,here : >>> >>> >>> https://www.reddit.com/r/homeassistant/comments/11wglx7/homeassisant_cant_be_installed_on_ubuntu_2004_the/ >>> >>> and he/she told me that ubuntu is not supported. So,which linux >>> distribution have you used within bhyve ? thanks. >>> >>> On Sun, Mar 19, 2023 at 7:12 PM Miroslav Lachman <000.fbsd@quip.cz> >>> wrote: >>> >>>> On 18/03/2023 14:59, Julie Koubová wrote: >>>> > Hey everyone, >>>> > >>>> > I'm running Linux (Home Assistant OS) in Bhyve on FreeBSD 13.1. I use >>>> > PCI passthrough to allow the VM to access a USB card with a couple of >>>> > radio dongles. The host machine is an Intel Core i3 13100 with 64 GB >>>> of >>>> > RAM. The CPU has 4 physical cores (8 hyper-threaded). The virtual >>>> > machine is assigned four cores. >>>> > >>>> > The host load averages are 0.39 0.39 0.40 right now, which seems way >>>> too >>>> > much. The same workload was previously handled by a Raspberry Pi 4, >>>> and >>>> > the CPU usage there was under 10% when not doing anything special. >>>> > Inside the guest OS, the CPU usage is reported around 5%, which seems >>>> > reasonable. >>>> > >>>> > What's wrong? How can I start debugging this issue? I use ZFS on the >>>> > host, vm-bhyve to manage the virtual machines, and I don't have a >>>> swap >>>> > partition. >>>> >>>> I had similar problem few years ago. Never solved. Exhibited on bhyve >>>> and VirtualBox too. The problem was "the more vCPU for VM, the slower >>>> VM". >>>> Can you try to set just 1 vCPU to your VM? In my case, VM with 1 vCPU >>>> was fast, almost no overhead, 2 v CPUs slightly slower but 4 or more >>>> was >>>> slow as hell. >>>> I would also recommend not to overprovision real CPU core count to vCPU >>>> and not use multi/hyper threading cores as real cores. With your CPU, >>>> use only 4 cores to assign to all your VMs (4 VMs with 1 vCPU each, or >>>> 2 >>>> VMs with 2 vCPU each, 1 VM with 4 vCPU) >>>> >>>> Miroslav Lachman >>>> >>>> >>>> >>> >>> -- >>> Mario. >>> >> -- >> Nikita Olenets >> >> > > -- > Mario. > -- Nikita Olenets [-- Attachment #2 --] <div dir="auto">Hey Mario,</div><div dir="auto"><br></div><div dir="auto">Yeah, sorry. I was thinking that you were the topic starter and you were trying to make things work under bhyve.</div><div dir="auto"><br></div><div dir="auto">Have a goo day.</div><div dir="auto"><br></div><div dir="auto">— Nikita</div><div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Tue, Mar 21, 2023 at 12:54 Mario Marietto <<a href="mailto:marietto2008@gmail.com">marietto2008@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Are you talking with me ? I can install Home Assistant only on the hardware that I already have. Actually the best piece of hardware that I can use for my project (installing the chat gpt module on Home Assistant + a speech recognition software to give a voice to chat gpt) is the nvidia jetson nano. And If I remember correctly,it supports only Ubuntu. I can do the same on my Workstation,but I prefer to have the ability to move the smaller nano within a plastic container. At the end of the day It will be almost the same as a vocal assistant,but uch more programmable. <br></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Tue, Mar 21, 2023 at 5:41 PM Nikita Olenets <<a href="mailto:zeon@zeon.kiev.ua" target="_blank">zeon@zeon.kiev.ua</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="auto">Hi,</div><div dir="auto"><br></div><div dir="auto">Is there any specific reason you want it to be installed under Ubuntu?</div><div dir="auto">I’m asking this because I use HasOS(home assistant OS) which is based on Linux (can’t recall the distribution) and I’m running this for three years now. No issues at all. I do have even passed through ZigBee usb stick and it works just fine.</div><div dir="auto"><br></div><div><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Mon, Mar 20, 2023 at 11:12 Mario Marietto <<a href="mailto:marietto2008@gmail.com" target="_blank">marietto2008@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div>Hello Julie.</div><div><br></div><div>As I said some days ago,I'm trying to install homeassistant. For the moment I'm using Ubuntu 20.04 that I have installed on the Jetson nano,but later I will use Ubuntu within bhyve on FreeBSD. Unfortunately,a developer,I suppose,told me that homeassistant is not supported on ubuntu. In Fact I tried to do that following this tutorial :</div><div><br></div><div><a href="https://vikoky.medium.com/jetson-nano-powered-house-29ce73f11de4" target="_blank">https://vikoky.medium.com/jetson-nano-powered-house-29ce73f11de4</a></div><div><br></div><div>but I've got a lot of errors. I've started a thread on reddit,asking for help,here :</div><div><br></div><div><a href="https://www.reddit.com/r/homeassistant/comments/11wglx7/homeassisant_cant_be_installed_on_ubuntu_2004_the/" target="_blank">https://www.reddit.com/r/homeassistant/comments/11wglx7/homeassisant_cant_be_installed_on_ubuntu_2004_the/</a></div><div><br></div><div>and he/she told me that ubuntu is not supported. So,which linux distribution have you used within bhyve ? thanks.<br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Sun, Mar 19, 2023 at 7:12 PM Miroslav Lachman <<a href="mailto:000.fbsd@quip.cz" target="_blank">000.fbsd@quip.cz</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">On 18/03/2023 14:59, Julie Koubová wrote:<br> > Hey everyone,<br> > <br> > I'm running Linux (Home Assistant OS) in Bhyve on FreeBSD 13.1. I use <br> > PCI passthrough to allow the VM to access a USB card with a couple of <br> > radio dongles. The host machine is an Intel Core i3 13100 with 64 GB of <br> > RAM. The CPU has 4 physical cores (8 hyper-threaded). The virtual <br> > machine is assigned four cores.<br> > <br> > The host load averages are 0.39 0.39 0.40 right now, which seems way too <br> > much. The same workload was previously handled by a Raspberry Pi 4, and <br> > the CPU usage there was under 10% when not doing anything special. <br> > Inside the guest OS, the CPU usage is reported around 5%, which seems <br> > reasonable.<br> > <br> > What's wrong? How can I start debugging this issue? I use ZFS on the <br> > host, vm-bhyve to manage the virtual machines, and I don't have a swap <br> > partition.<br> <br> I had similar problem few years ago. Never solved. Exhibited on bhyve <br> and VirtualBox too. The problem was "the more vCPU for VM, the slower VM".<br> Can you try to set just 1 vCPU to your VM? In my case, VM with 1 vCPU <br> was fast, almost no overhead, 2 v CPUs slightly slower but 4 or more was <br> slow as hell.<br> I would also recommend not to overprovision real CPU core count to vCPU <br> and not use multi/hyper threading cores as real cores. With your CPU, <br> use only 4 cores to assign to all your VMs (4 VMs with 1 vCPU each, or 2 <br> VMs with 2 vCPU each, 1 VM with 4 vCPU)<br> <br> Miroslav Lachman<br> <br> <br> </blockquote></div><br clear="all"><br><span>-- </span><br><div dir="ltr">Mario.<br></div> </blockquote></div></div>-- <br><div dir="ltr"><div dir="ltr"><div>Nikita Olenets<br><br></div></div></div> </blockquote></div><br clear="all"><br><span>-- </span><br><div dir="ltr">Mario.<br></div> </blockquote></div></div>-- <br><div dir="ltr" class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div>Nikita Olenets<br><br></div></div></div>
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAJ5wse0J%2BJm3KGHMyNSQO%2BApQCEva6o0meAW4xVf3rcKyT8ukA>