Date: Mon, 1 Aug 2022 20:24:44 +0300 From: Vitaliy Gusev <gusev.vitaliy@gmail.com> To: Andriy Gapon <avg@FreeBSD.org> Cc: current@freebsd.org, virtualization@freebsd.org Subject: Re: problem with bhyve, ryzen 5800x, freebsd guest Message-ID: <D2A2BCD1-7AD0-47E0-A2E5-D2F53D5FE1F3@gmail.com> In-Reply-To: <70b44a39-1df2-0f4e-42ac-9710ab82d028@FreeBSD.org> References: <e7e52823-21d4-99a8-bc97-05c2a54a559b@FreeBSD.org> <YssMJeSqK5fXZUpZ@FreeBSD.org> <70b44a39-1df2-0f4e-42ac-9710ab82d028@FreeBSD.org>
next in thread | previous in thread | raw e-mail | index | archive | help
--Apple-Mail=_FA2EEDB9-6782-4E0D-9AFD-58F553637AE0 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 Interesting enough. It would be nice if you find out what exactly = triggered your VM to reset. =E2=80=94 Vitaliy > On 1 Aug 2022, at 17:39, Andriy Gapon <avg@FreeBSD.org> wrote: >=20 > On 2022-07-10 20:28, Gleb Smirnoff wrote: >> On Thu, Jul 07, 2022 at 03:29:04PM +0300, Andriy Gapon wrote: >> A> I have a strange issue with running an 'appliance' image based on >> A> FreeBSD 12 in bhyve on a machine with Ryzen 5800x processor. >> A> >> A> The problem is that the guest would run for a while and then the = host >> A> would suddenly reset itself. It appears like a triple fault or >> A> something with similar consequences. >> A> >> A> The time may be from a few dozens of minutes to many hours. >> A> >> A> Just to be clear, no such thing occurs if I do not run the guest. >> A> Also, I have an older AMD system (pre-Zen), the problem does not = happen >> A> there. >> A> A vanilla FreeBSD 12.3 installation that just sits idle also does = not >> A> cause the problem. >> A> >> A> Does anyone have an idea what the problem could be? >> A> What workaround or diagnostics to try? >> A> Anybody else seen something like this? >> A> >> A> Since it's the host that resets it would be hard to capture any = traces. >> I also run bhyve on Ryzen since late 2021 and never had such an = issue. >> But not FreeBSD 12, I run the head. >=20 >=20 > Thank you everyone who responded. It seems that the problem was with = some BIOS configuration changes, probably related to the power settings. > Once I reset everything to factory defaults (plus some minimum "safe" = and well-understood changes) the problem went away. > It's really surprising that I saw it only with bhyve and only with the = particular kind of VMs. Perhaps there was a workload pattern that = triggered a hardware bug or overloaded some specific module. >=20 > Anyways, sorry for the noise and thank you for the help. >=20 > --=20 > Andriy Gapon >=20 >=20 > https://standforukraine.com <https://standforukraine.com/>; > https://razomforukraine.org <https://razomforukraine.org/>; --Apple-Mail=_FA2EEDB9-6782-4E0D-9AFD-58F553637AE0 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=utf-8 <html><head><meta http-equiv=3D"Content-Type" content=3D"text/html; = charset=3Dutf-8"></head><body style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; line-break: after-white-space;" = class=3D"">Interesting enough. It would be nice if you find out what = exactly triggered your VM to reset.<div class=3D""><br = class=3D""></div><div class=3D"">=E2=80=94</div><div class=3D"">Vitaliy<br= class=3D""><div><br class=3D""><blockquote type=3D"cite" class=3D""><div = class=3D"">On 1 Aug 2022, at 17:39, Andriy Gapon <<a = href=3D"mailto:avg@FreeBSD.org" class=3D"">avg@FreeBSD.org</a>> = wrote:</div><br class=3D"Apple-interchange-newline"><div class=3D""><meta = charset=3D"UTF-8" class=3D""><span style=3D"caret-color: rgb(0, 0, 0); = font-family: Helvetica; font-size: 14px; font-style: normal; = font-variant-caps: normal; font-weight: 400; letter-spacing: normal; = text-align: start; text-indent: 0px; text-transform: none; white-space: = normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; = text-decoration: none; float: none; display: inline !important;" = class=3D"">On 2022-07-10 20:28, Gleb Smirnoff wrote:</span><br = style=3D"caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: = 14px; font-style: normal; font-variant-caps: normal; font-weight: 400; = letter-spacing: normal; text-align: start; text-indent: 0px; = text-transform: none; white-space: normal; word-spacing: 0px; = -webkit-text-stroke-width: 0px; text-decoration: none;" = class=3D""><blockquote type=3D"cite" style=3D"font-family: Helvetica; = font-size: 14px; font-style: normal; font-variant-caps: normal; = font-weight: 400; letter-spacing: normal; orphans: auto; text-align: = start; text-indent: 0px; text-transform: none; white-space: normal; = widows: auto; word-spacing: 0px; -webkit-text-size-adjust: auto; = -webkit-text-stroke-width: 0px; text-decoration: none;" class=3D"">On = Thu, Jul 07, 2022 at 03:29:04PM +0300, Andriy Gapon wrote:<br = class=3D"">A> I have a strange issue with running an 'appliance' = image based on<br class=3D"">A> FreeBSD 12 in bhyve on a machine with = Ryzen 5800x processor.<br class=3D"">A><br class=3D"">A> The = problem is that the guest would run for a while and then the host<br = class=3D"">A> would suddenly reset itself. It appears like a triple = fault or<br class=3D"">A> something with similar consequences.<br = class=3D"">A><br class=3D"">A> The time may be from a few dozens = of minutes to many hours.<br class=3D"">A><br class=3D"">A> Just = to be clear, no such thing occurs if I do not run the guest.<br = class=3D"">A> Also, I have an older AMD system (pre-Zen), the problem = does not happen<br class=3D"">A> there.<br class=3D"">A> A vanilla = FreeBSD 12.3 installation that just sits idle also does not<br = class=3D"">A> cause the problem.<br class=3D"">A><br = class=3D"">A> Does anyone have an idea what the problem could be?<br = class=3D"">A> What workaround or diagnostics to try?<br = class=3D"">A> Anybody else seen something like this?<br = class=3D"">A><br class=3D"">A> Since it's the host that resets it = would be hard to capture any traces.<br class=3D"">I also run bhyve on = Ryzen since late 2021 and never had such an issue.<br class=3D"">But not = FreeBSD 12, I run the head.<br class=3D""></blockquote><br = style=3D"caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: = 14px; font-style: normal; font-variant-caps: normal; font-weight: 400; = letter-spacing: normal; text-align: start; text-indent: 0px; = text-transform: none; white-space: normal; word-spacing: 0px; = -webkit-text-stroke-width: 0px; text-decoration: none;" class=3D""><br = style=3D"caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: = 14px; font-style: normal; font-variant-caps: normal; font-weight: 400; = letter-spacing: normal; text-align: start; text-indent: 0px; = text-transform: none; white-space: normal; word-spacing: 0px; = -webkit-text-stroke-width: 0px; text-decoration: none;" class=3D""><span = style=3D"caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: = 14px; font-style: normal; font-variant-caps: normal; font-weight: 400; = letter-spacing: normal; text-align: start; text-indent: 0px; = text-transform: none; white-space: normal; word-spacing: 0px; = -webkit-text-stroke-width: 0px; text-decoration: none; float: none; = display: inline !important;" class=3D"">Thank you everyone who = responded. It seems that the problem was with some BIOS configuration = changes, probably related to the power settings.</span><br = style=3D"caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: = 14px; font-style: normal; font-variant-caps: normal; font-weight: 400; = letter-spacing: normal; text-align: start; text-indent: 0px; = text-transform: none; white-space: normal; word-spacing: 0px; = -webkit-text-stroke-width: 0px; text-decoration: none;" class=3D""><span = style=3D"caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: = 14px; font-style: normal; font-variant-caps: normal; font-weight: 400; = letter-spacing: normal; text-align: start; text-indent: 0px; = text-transform: none; white-space: normal; word-spacing: 0px; = -webkit-text-stroke-width: 0px; text-decoration: none; float: none; = display: inline !important;" class=3D"">Once I reset everything to = factory defaults (plus some minimum "safe" and well-understood changes) = the problem went away.</span><br style=3D"caret-color: rgb(0, 0, 0); = font-family: Helvetica; font-size: 14px; font-style: normal; = font-variant-caps: normal; font-weight: 400; letter-spacing: normal; = text-align: start; text-indent: 0px; text-transform: none; white-space: = normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; = text-decoration: none;" class=3D""><span style=3D"caret-color: rgb(0, 0, = 0); font-family: Helvetica; font-size: 14px; font-style: normal; = font-variant-caps: normal; font-weight: 400; letter-spacing: normal; = text-align: start; text-indent: 0px; text-transform: none; white-space: = normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; = text-decoration: none; float: none; display: inline !important;" = class=3D"">It's really surprising that I saw it only with bhyve and only = with the particular kind of VMs. Perhaps there was a workload pattern = that triggered a hardware bug or overloaded some specific = module.</span><br style=3D"caret-color: rgb(0, 0, 0); font-family: = Helvetica; font-size: 14px; font-style: normal; font-variant-caps: = normal; font-weight: 400; letter-spacing: normal; text-align: start; = text-indent: 0px; text-transform: none; white-space: normal; = word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: = none;" class=3D""><br style=3D"caret-color: rgb(0, 0, 0); font-family: = Helvetica; font-size: 14px; font-style: normal; font-variant-caps: = normal; font-weight: 400; letter-spacing: normal; text-align: start; = text-indent: 0px; text-transform: none; white-space: normal; = word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: = none;" class=3D""><span style=3D"caret-color: rgb(0, 0, 0); font-family: = Helvetica; font-size: 14px; font-style: normal; font-variant-caps: = normal; font-weight: 400; letter-spacing: normal; text-align: start; = text-indent: 0px; text-transform: none; white-space: normal; = word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: = none; float: none; display: inline !important;" class=3D"">Anyways, = sorry for the noise and thank you for the help.</span><br = style=3D"caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: = 14px; font-style: normal; font-variant-caps: normal; font-weight: 400; = letter-spacing: normal; text-align: start; text-indent: 0px; = text-transform: none; white-space: normal; word-spacing: 0px; = -webkit-text-stroke-width: 0px; text-decoration: none;" class=3D""><br = style=3D"caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: = 14px; font-style: normal; font-variant-caps: normal; font-weight: 400; = letter-spacing: normal; text-align: start; text-indent: 0px; = text-transform: none; white-space: normal; word-spacing: 0px; = -webkit-text-stroke-width: 0px; text-decoration: none;" class=3D""><span = style=3D"caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: = 14px; font-style: normal; font-variant-caps: normal; font-weight: 400; = letter-spacing: normal; text-align: start; text-indent: 0px; = text-transform: none; white-space: normal; word-spacing: 0px; = -webkit-text-stroke-width: 0px; text-decoration: none; float: none; = display: inline !important;" class=3D"">--<span = class=3D"Apple-converted-space"> </span></span><br = style=3D"caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: = 14px; font-style: normal; font-variant-caps: normal; font-weight: 400; = letter-spacing: normal; text-align: start; text-indent: 0px; = text-transform: none; white-space: normal; word-spacing: 0px; = -webkit-text-stroke-width: 0px; text-decoration: none;" class=3D""><span = style=3D"caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: = 14px; font-style: normal; font-variant-caps: normal; font-weight: 400; = letter-spacing: normal; text-align: start; text-indent: 0px; = text-transform: none; white-space: normal; word-spacing: 0px; = -webkit-text-stroke-width: 0px; text-decoration: none; float: none; = display: inline !important;" class=3D"">Andriy Gapon</span><br = style=3D"caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: = 14px; font-style: normal; font-variant-caps: normal; font-weight: 400; = letter-spacing: normal; text-align: start; text-indent: 0px; = text-transform: none; white-space: normal; word-spacing: 0px; = -webkit-text-stroke-width: 0px; text-decoration: none;" class=3D""><br = style=3D"caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: = 14px; font-style: normal; font-variant-caps: normal; font-weight: 400; = letter-spacing: normal; text-align: start; text-indent: 0px; = text-transform: none; white-space: normal; word-spacing: 0px; = -webkit-text-stroke-width: 0px; text-decoration: none;" class=3D""><br = style=3D"caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: = 14px; font-style: normal; font-variant-caps: normal; font-weight: 400; = letter-spacing: normal; text-align: start; text-indent: 0px; = text-transform: none; white-space: normal; word-spacing: 0px; = -webkit-text-stroke-width: 0px; text-decoration: none;" class=3D""><a = href=3D"https://standforukraine.com/" style=3D"font-family: Helvetica; = font-size: 14px; font-style: normal; font-variant-caps: normal; = font-weight: 400; letter-spacing: normal; orphans: auto; text-align: = start; text-indent: 0px; text-transform: none; white-space: normal; = widows: auto; word-spacing: 0px; -webkit-text-size-adjust: auto; = -webkit-text-stroke-width: 0px;" = class=3D"">https://standforukraine.com</a><br style=3D"caret-color: = rgb(0, 0, 0); font-family: Helvetica; font-size: 14px; font-style: = normal; font-variant-caps: normal; font-weight: 400; letter-spacing: = normal; text-align: start; text-indent: 0px; text-transform: none; = white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; = text-decoration: none;" class=3D""><a = href=3D"https://razomforukraine.org/" style=3D"font-family: Helvetica; = font-size: 14px; font-style: normal; font-variant-caps: normal; = font-weight: 400; letter-spacing: normal; orphans: auto; text-align: = start; text-indent: 0px; text-transform: none; white-space: normal; = widows: auto; word-spacing: 0px; -webkit-text-size-adjust: auto; = -webkit-text-stroke-width: 0px;" = class=3D"">https://razomforukraine.org</a></div></blockquote></div><br = class=3D""></div></body></html>= --Apple-Mail=_FA2EEDB9-6782-4E0D-9AFD-58F553637AE0--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?D2A2BCD1-7AD0-47E0-A2E5-D2F53D5FE1F3>