Date: Mon, 1 Aug 2022 20:24:44 +0300 From: Vitaliy Gusev <gusev.vitaliy@gmail.com> To: Andriy Gapon <avg@FreeBSD.org> Cc: current@freebsd.org, virtualization@freebsd.org Subject: Re: problem with bhyve, ryzen 5800x, freebsd guest Message-ID: <D2A2BCD1-7AD0-47E0-A2E5-D2F53D5FE1F3@gmail.com> In-Reply-To: <70b44a39-1df2-0f4e-42ac-9710ab82d028@FreeBSD.org> References: <e7e52823-21d4-99a8-bc97-05c2a54a559b@FreeBSD.org> <YssMJeSqK5fXZUpZ@FreeBSD.org> <70b44a39-1df2-0f4e-42ac-9710ab82d028@FreeBSD.org>
next in thread | previous in thread | raw e-mail | index | archive | help
[-- Attachment #1 --] Interesting enough. It would be nice if you find out what exactly triggered your VM to reset. — Vitaliy > On 1 Aug 2022, at 17:39, Andriy Gapon <avg@FreeBSD.org> wrote: > > On 2022-07-10 20:28, Gleb Smirnoff wrote: >> On Thu, Jul 07, 2022 at 03:29:04PM +0300, Andriy Gapon wrote: >> A> I have a strange issue with running an 'appliance' image based on >> A> FreeBSD 12 in bhyve on a machine with Ryzen 5800x processor. >> A> >> A> The problem is that the guest would run for a while and then the host >> A> would suddenly reset itself. It appears like a triple fault or >> A> something with similar consequences. >> A> >> A> The time may be from a few dozens of minutes to many hours. >> A> >> A> Just to be clear, no such thing occurs if I do not run the guest. >> A> Also, I have an older AMD system (pre-Zen), the problem does not happen >> A> there. >> A> A vanilla FreeBSD 12.3 installation that just sits idle also does not >> A> cause the problem. >> A> >> A> Does anyone have an idea what the problem could be? >> A> What workaround or diagnostics to try? >> A> Anybody else seen something like this? >> A> >> A> Since it's the host that resets it would be hard to capture any traces. >> I also run bhyve on Ryzen since late 2021 and never had such an issue. >> But not FreeBSD 12, I run the head. > > > Thank you everyone who responded. It seems that the problem was with some BIOS configuration changes, probably related to the power settings. > Once I reset everything to factory defaults (plus some minimum "safe" and well-understood changes) the problem went away. > It's really surprising that I saw it only with bhyve and only with the particular kind of VMs. Perhaps there was a workload pattern that triggered a hardware bug or overloaded some specific module. > > Anyways, sorry for the noise and thank you for the help. > > -- > Andriy Gapon > > > https://standforukraine.com <https://standforukraine.com/>; > https://razomforukraine.org <https://razomforukraine.org/>; [-- Attachment #2 --] <html><head><meta http-equiv="Content-Type" content="text/html; charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">Interesting enough. It would be nice if you find out what exactly triggered your VM to reset.<div class=""><br class=""></div><div class="">—</div><div class="">Vitaliy<br class=""><div><br class=""><blockquote type="cite" class=""><div class="">On 1 Aug 2022, at 17:39, Andriy Gapon <<a href="mailto:avg@FreeBSD.org" class="">avg@FreeBSD.org</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><meta charset="UTF-8" class=""><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 14px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">On 2022-07-10 20:28, Gleb Smirnoff wrote:</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 14px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""><blockquote type="cite" style="font-family: Helvetica; font-size: 14px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; text-decoration: none;" class="">On Thu, Jul 07, 2022 at 03:29:04PM +0300, Andriy Gapon wrote:<br class="">A> I have a strange issue with running an 'appliance' image based on<br class="">A> FreeBSD 12 in bhyve on a machine with Ryzen 5800x processor.<br class="">A><br class="">A> The problem is that the guest would run for a while and then the host<br class="">A> would suddenly reset itself. It appears like a triple fault or<br class="">A> something with similar consequences.<br class="">A><br class="">A> The time may be from a few dozens of minutes to many hours.<br class="">A><br class="">A> Just to be clear, no such thing occurs if I do not run the guest.<br class="">A> Also, I have an older AMD system (pre-Zen), the problem does not happen<br class="">A> there.<br class="">A> A vanilla FreeBSD 12.3 installation that just sits idle also does not<br class="">A> cause the problem.<br class="">A><br class="">A> Does anyone have an idea what the problem could be?<br class="">A> What workaround or diagnostics to try?<br class="">A> Anybody else seen something like this?<br class="">A><br class="">A> Since it's the host that resets it would be hard to capture any traces.<br class="">I also run bhyve on Ryzen since late 2021 and never had such an issue.<br class="">But not FreeBSD 12, I run the head.<br class=""></blockquote><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 14px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 14px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 14px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">Thank you everyone who responded. It seems that the problem was with some BIOS configuration changes, probably related to the power settings.</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 14px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 14px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">Once I reset everything to factory defaults (plus some minimum "safe" and well-understood changes) the problem went away.</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 14px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 14px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">It's really surprising that I saw it only with bhyve and only with the particular kind of VMs. Perhaps there was a workload pattern that triggered a hardware bug or overloaded some specific module.</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 14px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 14px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 14px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">Anyways, sorry for the noise and thank you for the help.</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 14px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 14px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 14px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">--<span class="Apple-converted-space"> </span></span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 14px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 14px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">Andriy Gapon</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 14px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 14px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 14px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""><a href="https://standforukraine.com/" style="font-family: Helvetica; font-size: 14px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px;" class="">https://standforukraine.com</a><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 14px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""><a href="https://razomforukraine.org/" style="font-family: Helvetica; font-size: 14px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px;" class="">https://razomforukraine.org</a></div></blockquote></div><br class=""></div></body></html>
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?D2A2BCD1-7AD0-47E0-A2E5-D2F53D5FE1F3>