Date: Tue, 27 Feb 2018 15:30:53 -0800 From: Peter Grehan <grehan@freebsd.org> To: Mike Tancsa <mike@sentex.net> Cc: "freebsd-virtualization@freebsd.org" <freebsd-virtualization@freebsd.org> Subject: Re: Ryzen lockup on bhyve was (Re: new Ryzen lockup issue ?) Message-ID: <a7ede219-73a6-80a3-87be-ce27769cfcd1@freebsd.org> In-Reply-To: <48768738-e699-fd06-9154-9b5be1bbabcc@sentex.net> References: <a687883a-b2a8-5b18-f63e-754a2ed445c0@sentex.net> <bbcc09cf-0072-8510-156f-5c20c301d43f@sentex.net> <92a60e14-f532-2647-d45d-b500fc59ba88@sentex.net> <CAMgUhpo1C_0L86Xkzmuz5%2Be3C3zk5RNkVS9aEBEwF-2XZ4d1sQ@mail.gmail.com> <425be16f-9fdc-9ed6-72b1-02e28bfd130f@sentex.net> <2f2b6f96-d6ef-8e02-966d-dcbbfb0c92fb@freebsd.org> <48768738-e699-fd06-9154-9b5be1bbabcc@sentex.net>
next in thread | previous in thread | raw e-mail | index | archive | help
Hi Mike, >> =C2=A0I could reproduce this on a Ryzen 1700 with HT enabled - it too= k ~700 >> seconds, and the entire machine locked up. >> >> =C2=A0An interesting point is a single VM was able to run to completi= on. >> >> =C2=A0I'll keep testing with various combinations of numbers of VMs, >> different vCPUs per VM, and pinning guest vCPUs. 3 4*vCPU guests locked the machine up in ~170 secs, 4 guests ran to=20 completion :( > Not sure if its related to core count or not, but it takes several > instances on the Epyc to lock up and takes a lot longer. I enabled IOMM= U > on it as well, and it's dmesg shows below. But the lockups are still > there with or without it enabled. Would you be able to try on the Epyc with vCPUs pinned, and all guest=20 vCPUs on different physical CPUs ? i.e. for a configuration that will lock up, run the same configuration=20 but with vCPUs pinned. For example, a 4 vCPU guest that will have vCPUs=20 0-3 pinned to host physical CPUs 7-10 would look like: -c 4 -p 0:7 -p 1:8 -p 2:9 -p 3:10 later, Peter.
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?a7ede219-73a6-80a3-87be-ce27769cfcd1>