Skip site navigation (1)Skip section navigation (2)
Date:      Mon, 27 Apr 2020 03:21:56 -0400
From:      Aryeh Friedman <aryeh.friedman@gmail.com>
To:        Anish <akgupt3@gmail.com>
Cc:        Christian Jeannot <info@os-plus.org>,  "freebsd-virtualization@freebsd.org" <freebsd-virtualization@freebsd.org>
Subject:   Re: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570
Message-ID:  <CAGBxaXnybTDOSdnxH=_W=gwz_n9QNHJYtRD-_ZZXAV_RHUedLw@mail.gmail.com>
In-Reply-To: <CALnRwMRkUAqyGy8UbW8qz=xvU8MGd8ZLwomg_dfqz7i9nUJF_Q@mail.gmail.com>
References:  <mailman.5.1587902400.74025.freebsd-virtualization@freebsd.org> <E1786CED-A643-41BC-9BE8-213085683673@posteo.de> <eedb50b0-1b49-4982-0f10-01a9fedab8fa@os-plus.org> <CALnRwMRkUAqyGy8UbW8qz=xvU8MGd8ZLwomg_dfqz7i9nUJF_Q@mail.gmail.com>

next in thread | previous in thread | raw e-mail | index | archive | help
On Mon, Apr 27, 2020 at 2:58 AM Anish <akgupt3@gmail.com> wrote:

> Hi Christian,
>
> This looks like BIOS issue, BIOS must not set Bit4/SVMDIS in VM_CR MSR
> (0xC001_0114) if SVM is enabled. Bhyve checks for this bit before
> enabling SVM. You can read it using the following steps:
> $kldload cpuctl
>
>
> $ cpucontrol -m 0xc0010114 /dev/cpuctlX <- Read VM_CR MSR
> MSR 0xc0010114: 0x00000000 0x00000008
>
> X is any CPU core number.
>

Again it is likely not a BIOS issues since the OP and me have nearly
identical setups (same MB manufacturer/same product line for both the CPU
and MB as well the same BIOS in most likely hood) and I get the following
(which works):

root@neomarx:~ # kldload cpuctl
root@neomarx:~ # cpucontrol -m 0xc0010114 /dev/cpuctl0
MSR 0xc0010114: 0x00000000 0x00000008

My BIOS: 7C02v1D 2019-11-11
OP BIOS: 7C35v18 2020-01-16

So if anything his should work and mine not work.

@OP do you have IOMMU support on or to auto (that is the one possible
setting you didn't state in your initial post -- mine is auto)



>
> On my AMD/Ryzen system, bit4 is clear and I can load bhyve. I have attach=
ed
> a screenshot from AMD SDM Vol2, which you may find useful.
>
> [image: Screen Shot 2020-04-26 at 12.01.14 PM.png]
>
> -Anish
>
>
>
> On Sun, Apr 26, 2020 at 6:27 AM Christian Jeannot <info@os-plus.org>
> wrote:
>
> > I have checked MSI support page. The latest BIOS version is already
> > installed.
> >
> > Regards
> >
> > --Christian
> >
> > Am 26.04.20 um 15:11 schrieb M. Eisenhardt:
> > > I would suggest to update your bios.
> > > Kind regards
> > > Michael
> > >
> > >> Am 26.04.2020 um 14:00 schrieb
> > freebsd-virtualization-request@freebsd.org:
> > >>
> > >> =EF=BB=BFSend freebsd-virtualization mailing list submissions to
> > >>     freebsd-virtualization@freebsd.org
> > >>
> > >> To subscribe or unsubscribe via the World Wide Web, visit
> > >>     https://lists.freebsd.org/mailman/listinfo/freebsd-virtualizatio=
n
> > >> or, via email, send a message with subject or body 'help' to
> > >>     freebsd-virtualization-request@freebsd.org
> > >>
> > >> You can reach the person managing the list at
> > >>     freebsd-virtualization-owner@freebsd.org
> > >>
> > >> When replying, please edit your Subject line so it is more specific
> > >> than "Re: Contents of freebsd-virtualization digest..."
> > >>
> > >>
> > >> Today's Topics:
> > >>
> > >>    1. bhyve with AMD Ryzen 3900X and MSI MEG ACE X570
> > >>       (Christian Jeannot)
> > >>    2. Re: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570
> > >>       (Aryeh Friedman)
> > >>    3. Re: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570
> > >>       (Christian Jeannot)
> > >>
> > >>
> > >> --------------------------------------------------------------------=
--
> > >>
> > >> Message: 1
> > >> Date: Sun, 26 Apr 2020 10:57:50 +0200
> > >> From: Christian Jeannot <info@os-plus.org>
> > >> To: freebsd-virtualization@freebsd.org
> > >> Subject: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570
> > >> Message-ID: <2535c7f2-ef59-467e-779b-6c9c6db82005@os-plus.org>
> > >> Content-Type: text/plain; charset=3Dutf-8; format=3Dflowed
> > >>
> > >> Hi Community,
> > >>
> > >> I am testing bhyve from FreeBSD 12.1 RELEASE.
> > >>
> > >> My environment:
> > >> - CPU: AMD Ryze 3900X
> > >> - Mainboard: MSI MEG ACE X570, Default settings, latest BIOS 7C35v18
> > >> - RAM: G.Skill RipJaws V DIMM Kit 64GB, DDR4-3200, CL16-18-18-38
> > >> - GPU: Sapphire Nitro RX 5700XT
> > >>
> > >> I checked the settings in the BIOS. Virtualization options are
> enabled.
> > >> SVM is enabled.
> > >>
> > >> I follow the instruction from the FreeBSD handbook ?21.7. FreeBSD as=
 a
> > >> Host with bhyve?.
> > >>
> > >> When I run
> > >>      kldload vmm
> > >> I got an output that SVM is disabled by BIOS. When I check the BIOS =
it
> > >> is enabled.
> > >>
> > >> When I try to start the VM with the example script I got the output
> > >>      vm_create device not configured
> > >>
> > >> Did I miss something to configure?
> > >>
> > >> Does anyone has a Ryzen CPU and a actual MSI mainboard successfully
> run
> > >> bhyve?
> > >>
> > >> Best regards
> > >>
> > >> ?Christian
> > >> --
> > >> --
> > >> christian jeannot
> > >> vogelmauer 17
> > >> 86152 augsburg
> > >> +49 821 81552861
> > >> info@os-plus.org
> > >>
> > >>
> > >> ------------------------------
> > >>
> > >> Message: 2
> > >> Date: Sun, 26 Apr 2020 05:32:36 -0400
> > >> From: Aryeh Friedman <aryeh.friedman@gmail.com>
> > >> To: Christian Jeannot <info@os-plus.org>
> > >> Cc: "freebsd-virtualization@freebsd.org"
> > >>     <freebsd-virtualization@freebsd.org>
> > >> Subject: Re: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570
> > >> Message-ID:
> > >>     <CAGBxaX=3Du-rzZ4MM0as-enpUCsDs=3D
> bx7oJAEmKsXigUbhf-9wrw@mail.gmail.com
> > >
> > >> Content-Type: text/plain; charset=3D"UTF-8"
> > >>
> > >>> On Sun, Apr 26, 2020 at 4:57 AM Christian Jeannot <info@os-plus.org=
>
> > wrote:
> > >>>
> > >>> Hi Community,
> > >>>
> > >>> I am testing bhyve from FreeBSD 12.1 RELEASE.
> > >>>
> > >>> My environment:
> > >>> - CPU: AMD Ryze 3900X
> > >>> - Mainboard: MSI MEG ACE X570, Default settings, latest BIOS 7C35v1=
8
> > >>> - RAM: G.Skill RipJaws V DIMM Kit 64GB, DDR4-3200, CL16-18-18-38
> > >>> - GPU: Sapphire Nitro RX 5700XT
> > >>>
> > >>> I checked the settings in the BIOS. Virtualization options are
> enabled.
> > >>> SVM is enabled.
> > >>>
> > >>> I follow the instruction from the FreeBSD handbook ?21.7. FreeBSD a=
s
> a
> > >>> Host with bhyve?.
> > >>>
> > >>> When I run
> > >>>      kldload vmm
> > >>> I got an output that SVM is disabled by BIOS. When I check the BIOS
> it
> > >>> is enabled.
> > >>>
> > >>
> > >> What happens if you load it from /boot/load.conf
> > >>
> > >> Also you shouldn't have to turn on kvm (I do have it turned on but i=
t
> > >> should not be required).
> > >>
> > >> Bhyve has a upper limit of 16 vm's that it can run at once but I don=
't
> > >> think this is based on core count of the processor.
> > >>
> > >>
> > >>> When I try to start the VM with the example script I got the output
> > >>>      vm_create device not configured
> > >>>
> > >>> Did I miss something to configure?
> > >>>
> > >>> Does anyone has a Ryzen CPU and a actual MSI mainboard successfully
> run
> > >>> bhyve?
> > >>>
> > >>
> > >> I have two Ryzen 5 2600X/MSI machines as far I can tell looking at t=
he
> > >> specs (and what I remember when I was deciding to get a 3900X or
> 2600X)
> > >> there is no practical difference, except for core count, from the
> point
> > of
> > >> view of virtualization/bhyve.  One machine is a MSI B450 Tomahawk an=
d
> > the
> > >> other is MSI B450 Gaming Pro.   Both machines run bhyve with out any
> > >> problem (one of them is my main home office server with 3 vm's on it
> > >> [windows and 2 FreeBSD]) and the other is my primary desktop machine
> and
> > >> used for R&D on PetiteCloud (which is a web interface to bhyve and
> > qemu).
> > >>
> > >> Best regards
> > >>>
> > >>> ?Christian
> > >>> --
> > >>> --
> > >>> christian jeannot
> > >>> vogelmauer 17
> > >>> 86152 augsburg
> > >>> +49 821 81552861
> > >>> info@os-plus.org
> > >>> _______________________________________________
> > >>> freebsd-virtualization@freebsd.org mailing list
> > >>> https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization
> > >>> To unsubscribe, send any mail to "
> > >>> freebsd-virtualization-unsubscribe@freebsd.org"
> > >>>
> > >>
> > >>
> > >> --
> > >> Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org
> > >>
> > >>
> > >> ------------------------------
> > >>
> > >> Message: 3
> > >> Date: Sun, 26 Apr 2020 11:56:39 +0200
> > >> From: Christian Jeannot <info@os-plus.org>
> > >> To: Aryeh Friedman <aryeh.friedman@gmail.com>
> > >> Cc: freebsd-virtualization@freebsd.org
> > >> Subject: Re: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570
> > >> Message-ID: <fdee36b6-31cd-5b3e-e760-b83664e5472d@os-plus.org>
> > >> Content-Type: text/plain; charset=3Dutf-8; format=3Dflowed
> > >>
> > >>
> > >>
> > >>> Am 26.04.20 um 11:32 schrieb Aryeh Friedman:
> > >>>
> > >>>
> > >>> On Sun, Apr 26, 2020 at 4:57 AM Christian Jeannot <info@os-plus.org
> > >>> <mailto:info@os-plus.org>> wrote:
> > >>>
> > >>>     Hi Community,
> > >>>
> > >>>     I am testing bhyve from FreeBSD 12.1 RELEASE.
> > >>>
> > >>>     My environment:
> > >>>     - CPU: AMD Ryze 3900X
> > >>>     - Mainboard: MSI MEG ACE X570, Default settings, latest BIOS
> > 7C35v18
> > >>>     - RAM: G.Skill RipJaws V DIMM Kit 64GB, DDR4-3200, CL16-18-18-3=
8
> > >>>     - GPU: Sapphire Nitro RX 5700XT
> > >>>
> > >>>     I checked the settings in the BIOS. Virtualization options are
> > enabled.
> > >>>     SVM is enabled.
> > >>>
> > >>>     I follow the instruction from the FreeBSD handbook ?21.7. FreeB=
SD
> > as a
> > >>>     Host with bhyve?.
> > >>>
> > >>>     When I run
> > >>>      ? ? ?kldload vmm
> > >>>     I got an output that SVM is disabled by BIOS. When I check the
> > BIOS it
> > >>>     is enabled.
> > >>>
> > >>>
> > >>> What happens if you load it from /boot/load.conf
> > >>
> > >> When I add
> > >>     vmm_load=3D"YES"
> > >> in /boot/loader.conf I can see the following with dmesg after a rebo=
ot
> > >>
> > >> SVM: disabled by BIOS.
> > >> module_register_init: MOD_LOAD (vmm, 0xffffffff8264dd20, 0) error 6
> > >>
> > >>>
> > >>> Also you shouldn't have to turn on kvm (I do have it turned on but =
it
> > >>> should not be required).
> > >>>
> > >>> Bhyve has a upper limit of 16 vm's that it can run at once but I
> don't
> > >>> think this is based on core count of the processor.
> > >>>
> > >>>
> > >>>     When I try to start the VM with the example script I got the
> output
> > >>>      ? ? ?vm_create device not configured
> > >>>
> > >>>     Did I miss something to configure?
> > >>>
> > >>>     Does anyone has a Ryzen CPU and a actual MSI mainboard
> > successfully run
> > >>>     bhyve?
> > >>>
> > >>>
> > >>> I have two Ryzen 5 2600X/MSI machines as far I can tell looking at
> the
> > >>> specs (and what I remember when I was deciding to get a 3900X or
> 2600X)
> > >>> there is no practical difference, except for core count, from the
> point
> > >>> of view of virtualization/bhyve.? One machine is a MSI B450 Tomahaw=
k
> > and
> > >>> the other is MSI B450 Gaming Pro.?? Both machines run bhyve with ou=
t
> > any
> > >>> problem (one of them is my main home office server with 3 vm's on i=
t
> > >>> [windows and 2 FreeBSD]) and the other is my primary desktop machin=
e
> > and
> > >>> used for R&D on PetiteCloud (which is a web interface to bhyve and
> > qemu).
> > >>
> > >> Thank you. Good to know that bhye is working with AMD CPUs, Mainboar=
ds
> > >> and chipsets.
> > >>
> > >> --Christian
> > >>
> > >> --
> > >> --
> > >> christian jeannot
> > >> vogelmauer 17
> > >> 86152 augsburg
> > >> +49 821 81552861
> > >> info@os-plus.org
> > >>
> > >>
> > >> ------------------------------
> > >>
> > >> Subject: Digest Footer
> > >>
> > >> _______________________________________________
> > >> freebsd-virtualization@freebsd.org mailing list
> > >> https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization
> > >> To unsubscribe, send any mail to "
> > freebsd-virtualization-unsubscribe@freebsd.org"
> > >>
> > >>
> > >> ------------------------------
> > >>
> > >> End of freebsd-virtualization Digest, Vol 490, Issue 5
> > >> ******************************************************
> > >
> > > _______________________________________________
> > > freebsd-virtualization@freebsd.org mailing list
> > > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization
> > > To unsubscribe, send any mail to "
> > freebsd-virtualization-unsubscribe@freebsd.org"
> > >
> >
> > --
> > --
> > christian jeannot
> > vogelmauer 17
> > 86152 augsburg
> > +49 821 81552861
> > info@os-plus.org
> > _______________________________________________
> > freebsd-virtualization@freebsd.org mailing list
> > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization
> > To unsubscribe, send any mail to "
> > freebsd-virtualization-unsubscribe@freebsd.org"
> >
> _______________________________________________
> freebsd-virtualization@freebsd.org mailing list
> https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization
> To unsubscribe, send any mail to "
> freebsd-virtualization-unsubscribe@freebsd.org"
>


--=20
Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAGBxaXnybTDOSdnxH=_W=gwz_n9QNHJYtRD-_ZZXAV_RHUedLw>