Date: Tue, 21 Mar 2023 18:04:43 +0100 From: Mario Marietto <marietto2008@gmail.com> To: Nikita Olenets <zeon@zeon.kiev.ua>, =?UTF-8?Q?Julie_Koubov=C3=A1?= <julie@koubova.net>, Miroslav Lachman <000.fbsd@quip.cz>, FreeBSD virtualization <freebsd-virtualization@freebsd.org> Subject: Re: Bhyve process consumes way too much CPU Message-ID: <CA%2B1FSigdN1wpjgi4xJyspjBsJnmUxUzswtwr6Df=8JE9U4jiPw@mail.gmail.com> In-Reply-To: <CAJ5wse0J%2BJm3KGHMyNSQO%2BApQCEva6o0meAW4xVf3rcKyT8ukA@mail.gmail.com> References: <CABQ-j0ZH-OrZSb866iVMba-ZfxOsovGoyLd=YZ=auOiNtm-TkA@mail.gmail.com> <CABQ-j0bbTQWhM1wgYvDvvwpxQexqgtYDgN4vj8pYp2Ttu_WHHg@mail.gmail.com> <343e827b-a1dc-b69b-9dcc-c6675deac070@quip.cz> <CA%2B1FSihrMf77N1Ec1wyndmvmJg5g6Ya9KJjKm9XcsM6o7R5V0g@mail.gmail.com> <CAJ5wse2Oyz%2B=P3ojNz8YqH79fKxJs7uOBzvMu7crkbxg_EykGQ@mail.gmail.com> <CA%2B1FSij5XiJ9o1Sgh8S2-y31XtUJ=GLMo6q6p-w49peApcDM5w@mail.gmail.com> <CAJ5wse0J%2BJm3KGHMyNSQO%2BApQCEva6o0meAW4xVf3rcKyT8ukA@mail.gmail.com>
index | next in thread | previous in thread | raw e-mail
[-- Attachment #1 --] Yeah,that's another project that I will work on soon. So speak please. I use bhyve every day. On Tue, Mar 21, 2023 at 6:00 PM Nikita Olenets <zeon@zeon.kiev.ua> wrote: > Hey Mario, > > Yeah, sorry. I was thinking that you were the topic starter and you were > trying to make things work under bhyve. > > Have a goo day. > > — Nikita > > On Tue, Mar 21, 2023 at 12:54 Mario Marietto <marietto2008@gmail.com> > wrote: > >> Are you talking with me ? I can install Home Assistant only on the >> hardware that I already have. Actually the best piece of hardware that I >> can use for my project (installing the chat gpt module on Home Assistant + >> a speech recognition software to give a voice to chat gpt) is the nvidia >> jetson nano. And If I remember correctly,it supports only Ubuntu. I can do >> the same on my Workstation,but I prefer to have the ability to move the >> smaller nano within a plastic container. At the end of the day It will be >> almost the same as a vocal assistant,but uch more programmable. >> >> On Tue, Mar 21, 2023 at 5:41 PM Nikita Olenets <zeon@zeon.kiev.ua> wrote: >> >>> Hi, >>> >>> Is there any specific reason you want it to be installed under Ubuntu? >>> I’m asking this because I use HasOS(home assistant OS) which is based on >>> Linux (can’t recall the distribution) and I’m running this for three years >>> now. No issues at all. I do have even passed through ZigBee usb stick and >>> it works just fine. >>> >>> On Mon, Mar 20, 2023 at 11:12 Mario Marietto <marietto2008@gmail.com> >>> wrote: >>> >>>> Hello Julie. >>>> >>>> As I said some days ago,I'm trying to install homeassistant. For the >>>> moment I'm using Ubuntu 20.04 that I have installed on the Jetson nano,but >>>> later I will use Ubuntu within bhyve on FreeBSD. Unfortunately,a >>>> developer,I suppose,told me that homeassistant is not supported on ubuntu. >>>> In Fact I tried to do that following this tutorial : >>>> >>>> https://vikoky.medium.com/jetson-nano-powered-house-29ce73f11de4 >>>> >>>> but I've got a lot of errors. I've started a thread on reddit,asking >>>> for help,here : >>>> >>>> >>>> https://www.reddit.com/r/homeassistant/comments/11wglx7/homeassisant_cant_be_installed_on_ubuntu_2004_the/ >>>> >>>> and he/she told me that ubuntu is not supported. So,which linux >>>> distribution have you used within bhyve ? thanks. >>>> >>>> On Sun, Mar 19, 2023 at 7:12 PM Miroslav Lachman <000.fbsd@quip.cz> >>>> wrote: >>>> >>>>> On 18/03/2023 14:59, Julie Koubová wrote: >>>>> > Hey everyone, >>>>> > >>>>> > I'm running Linux (Home Assistant OS) in Bhyve on FreeBSD 13.1. I >>>>> use >>>>> > PCI passthrough to allow the VM to access a USB card with a couple >>>>> of >>>>> > radio dongles. The host machine is an Intel Core i3 13100 with 64 GB >>>>> of >>>>> > RAM. The CPU has 4 physical cores (8 hyper-threaded). The virtual >>>>> > machine is assigned four cores. >>>>> > >>>>> > The host load averages are 0.39 0.39 0.40 right now, which seems way >>>>> too >>>>> > much. The same workload was previously handled by a Raspberry Pi 4, >>>>> and >>>>> > the CPU usage there was under 10% when not doing anything special. >>>>> > Inside the guest OS, the CPU usage is reported around 5%, which >>>>> seems >>>>> > reasonable. >>>>> > >>>>> > What's wrong? How can I start debugging this issue? I use ZFS on the >>>>> > host, vm-bhyve to manage the virtual machines, and I don't have a >>>>> swap >>>>> > partition. >>>>> >>>>> I had similar problem few years ago. Never solved. Exhibited on bhyve >>>>> and VirtualBox too. The problem was "the more vCPU for VM, the slower >>>>> VM". >>>>> Can you try to set just 1 vCPU to your VM? In my case, VM with 1 vCPU >>>>> was fast, almost no overhead, 2 v CPUs slightly slower but 4 or more >>>>> was >>>>> slow as hell. >>>>> I would also recommend not to overprovision real CPU core count to >>>>> vCPU >>>>> and not use multi/hyper threading cores as real cores. With your CPU, >>>>> use only 4 cores to assign to all your VMs (4 VMs with 1 vCPU each, or >>>>> 2 >>>>> VMs with 2 vCPU each, 1 VM with 4 vCPU) >>>>> >>>>> Miroslav Lachman >>>>> >>>>> >>>>> >>>> >>>> -- >>>> Mario. >>>> >>> -- >>> Nikita Olenets >>> >>> >> >> -- >> Mario. >> > -- > Nikita Olenets > > -- Mario. [-- Attachment #2 --] <div dir="ltr">Yeah,that's another project that I will work on soon. So speak please. I use bhyve every day. <br></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Tue, Mar 21, 2023 at 6:00 PM Nikita Olenets <<a href="mailto:zeon@zeon.kiev.ua" target="_blank">zeon@zeon.kiev.ua</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="auto">Hey Mario,</div><div dir="auto"><br></div><div dir="auto">Yeah, sorry. I was thinking that you were the topic starter and you were trying to make things work under bhyve.</div><div dir="auto"><br></div><div dir="auto">Have a goo day.</div><div dir="auto"><br></div><div dir="auto">— Nikita</div><div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Tue, Mar 21, 2023 at 12:54 Mario Marietto <<a href="mailto:marietto2008@gmail.com" target="_blank">marietto2008@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">Are you talking with me ? I can install Home Assistant only on the hardware that I already have. Actually the best piece of hardware that I can use for my project (installing the chat gpt module on Home Assistant + a speech recognition software to give a voice to chat gpt) is the nvidia jetson nano. And If I remember correctly,it supports only Ubuntu. I can do the same on my Workstation,but I prefer to have the ability to move the smaller nano within a plastic container. At the end of the day It will be almost the same as a vocal assistant,but uch more programmable. <br></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Tue, Mar 21, 2023 at 5:41 PM Nikita Olenets <<a href="mailto:zeon@zeon.kiev.ua" target="_blank">zeon@zeon.kiev.ua</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="auto">Hi,</div><div dir="auto"><br></div><div dir="auto">Is there any specific reason you want it to be installed under Ubuntu?</div><div dir="auto">I’m asking this because I use HasOS(home assistant OS) which is based on Linux (can’t recall the distribution) and I’m running this for three years now. No issues at all. I do have even passed through ZigBee usb stick and it works just fine.</div><div dir="auto"><br></div><div><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Mon, Mar 20, 2023 at 11:12 Mario Marietto <<a href="mailto:marietto2008@gmail.com" target="_blank">marietto2008@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div>Hello Julie.</div><div><br></div><div>As I said some days ago,I'm trying to install homeassistant. For the moment I'm using Ubuntu 20.04 that I have installed on the Jetson nano,but later I will use Ubuntu within bhyve on FreeBSD. Unfortunately,a developer,I suppose,told me that homeassistant is not supported on ubuntu. In Fact I tried to do that following this tutorial :</div><div><br></div><div><a href="https://vikoky.medium.com/jetson-nano-powered-house-29ce73f11de4" target="_blank">https://vikoky.medium.com/jetson-nano-powered-house-29ce73f11de4</a></div><div><br></div><div>but I've got a lot of errors. I've started a thread on reddit,asking for help,here :</div><div><br></div><div><a href="https://www.reddit.com/r/homeassistant/comments/11wglx7/homeassisant_cant_be_installed_on_ubuntu_2004_the/" target="_blank">https://www.reddit.com/r/homeassistant/comments/11wglx7/homeassisant_cant_be_installed_on_ubuntu_2004_the/</a></div><div><br></div><div>and he/she told me that ubuntu is not supported. So,which linux distribution have you used within bhyve ? thanks.<br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Sun, Mar 19, 2023 at 7:12 PM Miroslav Lachman <<a href="mailto:000.fbsd@quip.cz" target="_blank">000.fbsd@quip.cz</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">On 18/03/2023 14:59, Julie Koubová wrote:<br> > Hey everyone,<br> > <br> > I'm running Linux (Home Assistant OS) in Bhyve on FreeBSD 13.1. I use <br> > PCI passthrough to allow the VM to access a USB card with a couple of <br> > radio dongles. The host machine is an Intel Core i3 13100 with 64 GB of <br> > RAM. The CPU has 4 physical cores (8 hyper-threaded). The virtual <br> > machine is assigned four cores.<br> > <br> > The host load averages are 0.39 0.39 0.40 right now, which seems way too <br> > much. The same workload was previously handled by a Raspberry Pi 4, and <br> > the CPU usage there was under 10% when not doing anything special. <br> > Inside the guest OS, the CPU usage is reported around 5%, which seems <br> > reasonable.<br> > <br> > What's wrong? How can I start debugging this issue? I use ZFS on the <br> > host, vm-bhyve to manage the virtual machines, and I don't have a swap <br> > partition.<br> <br> I had similar problem few years ago. Never solved. Exhibited on bhyve <br> and VirtualBox too. The problem was "the more vCPU for VM, the slower VM".<br> Can you try to set just 1 vCPU to your VM? In my case, VM with 1 vCPU <br> was fast, almost no overhead, 2 v CPUs slightly slower but 4 or more was <br> slow as hell.<br> I would also recommend not to overprovision real CPU core count to vCPU <br> and not use multi/hyper threading cores as real cores. With your CPU, <br> use only 4 cores to assign to all your VMs (4 VMs with 1 vCPU each, or 2 <br> VMs with 2 vCPU each, 1 VM with 4 vCPU)<br> <br> Miroslav Lachman<br> <br> <br> </blockquote></div><br clear="all"><br><span>-- </span><br><div dir="ltr">Mario.<br></div> </blockquote></div></div>-- <br><div dir="ltr"><div dir="ltr"><div>Nikita Olenets<br><br></div></div></div> </blockquote></div><br clear="all"><br><span>-- </span><br><div dir="ltr">Mario.<br></div> </blockquote></div></div>-- <br><div dir="ltr"><div dir="ltr"><div>Nikita Olenets<br><br></div></div></div> </blockquote></div><br clear="all"><br><span>-- </span><br><div dir="ltr">Mario.<br></div>help
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CA%2B1FSigdN1wpjgi4xJyspjBsJnmUxUzswtwr6Df=8JE9U4jiPw>