From owner-freebsd-virtualization@freebsd.org Sun Apr 26 19:16:20 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id B9E172BA00A for ; Sun, 26 Apr 2020 19:16:20 +0000 (UTC) (envelope-from akgupt3@gmail.com) Received: from mail-wm1-x32e.google.com (mail-wm1-x32e.google.com [IPv6:2a00:1450:4864:20::32e]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 499Hh25zDnz3MQh for ; Sun, 26 Apr 2020 19:16:18 +0000 (UTC) (envelope-from akgupt3@gmail.com) Received: by mail-wm1-x32e.google.com with SMTP id x4so17159128wmj.1 for ; Sun, 26 Apr 2020 12:16:18 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=ZDHFA90z7UuaWpfw84+jGthrSDkvxGJhthls85QXW70=; b=AIgh20k6/rNdOgrXOL9A1fMxdZ+zAS/Xpr824dkRfXLQ/ypL2b9sC9hBILGZWHfpJC MvDjA800T6JUBzwcWiYv91zBUI8/Od32frjHitBNBkJp6jBcKErtAhVh1/S5MiRnRjlV 6qEAOn2nhiNp6yLaMhfSEeAliE9o+ZXTzLvgrRrvj6DHUXdS4nUuxqEHZ8kuVfXPad4D Zzc1pUpWk/oR91bVmFNL1PPIvREloN+B7QGP19hC7ef1uUqDujYWETz5Dk7P6XqLDvP7 0RvFWFZ68R13h6UnK8JpvBoeXahIb7pA+CDkSxgH1MZcRly9iWkNPDbcnMTBZF8fd4yL aw7w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=ZDHFA90z7UuaWpfw84+jGthrSDkvxGJhthls85QXW70=; b=JhdEgNRTUwKt73IJstZf5kyDz0NLKALt5lRjKpwy//eU5awlW3phFNfV4UM589nKL0 fJ2zAdKjKiROEHe9WyjpsM5Duc5wVuNBjWuQqu1etKUY3BCclRRKnXOB1wN+IXVqVsgg MP8I+CdFu9HYM28/HJNYBcT0GYw/S8baZHyzFg7gV6LsNvjimeeX3ccbTfcKaWylhto2 QLdg/X5kVDiSD5THoMkJmXmOzLy32fEigTPAqI8MKxkx7J44YUzuQjZNzXd2hhEYbr48 l3hne5cfSMvByqf0ardk7FovmfzeZ3NHectOnw+ceA0pS6KVrpBsyhJheuprfxebiP4r OtVQ== X-Gm-Message-State: AGi0PubtrCflXE4PB2Xnp1R52TN5fT/oHwtwFUcN1eKqE9wIKmWdCnci pge4GvfW9wHTgLjzpR5SGeB0pwE3Bf2rYzloe48= X-Google-Smtp-Source: APiQypKcDo5m2jDu177dV+C2h/9JpWnYvowoN/Do7P5W+bQfrqRgBCEBuNDlAmn0dWCgEBP6ZkKDYgbqMnn+3H897Ww= X-Received: by 2002:a05:600c:21d3:: with SMTP id x19mr21976652wmj.60.1587928576967; Sun, 26 Apr 2020 12:16:16 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Anish Date: Sun, 26 Apr 2020 12:16:05 -0700 Message-ID: Subject: Re: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 To: Christian Jeannot Cc: "freebsd-virtualization@freebsd.org" X-Rspamd-Queue-Id: 499Hh25zDnz3MQh X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=AIgh20k6; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of akgupt3@gmail.com designates 2a00:1450:4864:20::32e as permitted sender) smtp.mailfrom=akgupt3@gmail.com X-Spamd-Result: default: False [-3.00 / 15.00]; ARC_NA(0.00)[]; TO_DN_EQ_ADDR_SOME(0.00)[]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[multipart/related,multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; IP_SCORE_FREEMAIL(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[e.2.3.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.5.4.1.0.0.a.2.list.dnswl.org : 127.0.5.0]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; IP_SCORE(0.00)[ip: (-9.12), ipnet: 2a00:1450::/32(-2.33), asn: 15169(-0.43), country: US(-0.05)]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:+,3:~,4:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0] X-Mailman-Approved-At: Mon, 27 Apr 2020 09:56:44 +0000 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 26 Apr 2020 19:16:20 -0000 [Resending without screenshot to reduce message size] Hi Christian, This looks like BIOS issue, BIOS must not set Bit4/SVMDIS in VM_CR MSR (0xC001_0114) if SVM is enabled. Bhyve checks for this bit before enabling SVM, otherwise it can cause GP faults. You can read it using the following steps: $kldload cpuctl $ cpucontrol -m 0xc0010114 /dev/cpuctlX <- Read VM_CR MSR MSR 0xc0010114: 0x00000000 0x00000008 X is any CPU core number. On my AMD/Ryzen system, bit4 is clear and I can load bhyve. -Anish On Sun, Apr 26, 2020 at 12:07 PM Anish wrote: > > Hi Christian, > > This looks like BIOS issue, BIOS must not set Bit4/SVMDIS in VM_CR MSR > (0xC001_0114) if SVM is enabled. Bhyve checks for this bit before > enabling SVM. You can read it using the following steps: > $kldload cpuctl > > > $ cpucontrol -m 0xc0010114 /dev/cpuctlX <- Read VM_CR MSR > MSR 0xc0010114: 0x00000000 0x00000008 > > X is any CPU core number. > > On my AMD/Ryzen system, bit4 is clear and I can load bhyve. I have > attached a screenshot from AMD SDM Vol2, which you may find useful. > > [image: Screen Shot 2020-04-26 at 12.01.14 PM.png] > > -Anish > > > > On Sun, Apr 26, 2020 at 6:27 AM Christian Jeannot > wrote: > >> I have checked MSI support page. The latest BIOS version is already >> installed. >> >> Regards >> >> --Christian >> >> Am 26.04.20 um 15:11 schrieb M. Eisenhardt: >> > I would suggest to update your bios. >> > Kind regards >> > Michael >> > >> >> Am 26.04.2020 um 14:00 schrieb >> freebsd-virtualization-request@freebsd.org: >> >> >> >> =EF=BB=BFSend freebsd-virtualization mailing list submissions to >> >> freebsd-virtualization@freebsd.org >> >> >> >> To subscribe or unsubscribe via the World Wide Web, visit >> >> https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization >> >> or, via email, send a message with subject or body 'help' to >> >> freebsd-virtualization-request@freebsd.org >> >> >> >> You can reach the person managing the list at >> >> freebsd-virtualization-owner@freebsd.org >> >> >> >> When replying, please edit your Subject line so it is more specific >> >> than "Re: Contents of freebsd-virtualization digest..." >> >> >> >> >> >> Today's Topics: >> >> >> >> 1. bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 >> >> (Christian Jeannot) >> >> 2. Re: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 >> >> (Aryeh Friedman) >> >> 3. Re: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 >> >> (Christian Jeannot) >> >> >> >> >> >> ---------------------------------------------------------------------= - >> >> >> >> Message: 1 >> >> Date: Sun, 26 Apr 2020 10:57:50 +0200 >> >> From: Christian Jeannot >> >> To: freebsd-virtualization@freebsd.org >> >> Subject: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 >> >> Message-ID: <2535c7f2-ef59-467e-779b-6c9c6db82005@os-plus.org> >> >> Content-Type: text/plain; charset=3Dutf-8; format=3Dflowed >> >> >> >> Hi Community, >> >> >> >> I am testing bhyve from FreeBSD 12.1 RELEASE. >> >> >> >> My environment: >> >> - CPU: AMD Ryze 3900X >> >> - Mainboard: MSI MEG ACE X570, Default settings, latest BIOS 7C35v18 >> >> - RAM: G.Skill RipJaws V DIMM Kit 64GB, DDR4-3200, CL16-18-18-38 >> >> - GPU: Sapphire Nitro RX 5700XT >> >> >> >> I checked the settings in the BIOS. Virtualization options are enable= d. >> >> SVM is enabled. >> >> >> >> I follow the instruction from the FreeBSD handbook ?21.7. FreeBSD as = a >> >> Host with bhyve?. >> >> >> >> When I run >> >> kldload vmm >> >> I got an output that SVM is disabled by BIOS. When I check the BIOS i= t >> >> is enabled. >> >> >> >> When I try to start the VM with the example script I got the output >> >> vm_create device not configured >> >> >> >> Did I miss something to configure? >> >> >> >> Does anyone has a Ryzen CPU and a actual MSI mainboard successfully r= un >> >> bhyve? >> >> >> >> Best regards >> >> >> >> ?Christian >> >> -- >> >> -- >> >> christian jeannot >> >> vogelmauer 17 >> >> 86152 augsburg >> >> +49 821 81552861 >> >> info@os-plus.org >> >> >> >> >> >> ------------------------------ >> >> >> >> Message: 2 >> >> Date: Sun, 26 Apr 2020 05:32:36 -0400 >> >> From: Aryeh Friedman >> >> To: Christian Jeannot >> >> Cc: "freebsd-virtualization@freebsd.org" >> >> >> >> Subject: Re: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 >> >> Message-ID: >> >> > bx7oJAEmKsXigUbhf-9wrw@mail.gmail.com> >> >> Content-Type: text/plain; charset=3D"UTF-8" >> >> >> >>> On Sun, Apr 26, 2020 at 4:57 AM Christian Jeannot >> wrote: >> >>> >> >>> Hi Community, >> >>> >> >>> I am testing bhyve from FreeBSD 12.1 RELEASE. >> >>> >> >>> My environment: >> >>> - CPU: AMD Ryze 3900X >> >>> - Mainboard: MSI MEG ACE X570, Default settings, latest BIOS 7C35v18 >> >>> - RAM: G.Skill RipJaws V DIMM Kit 64GB, DDR4-3200, CL16-18-18-38 >> >>> - GPU: Sapphire Nitro RX 5700XT >> >>> >> >>> I checked the settings in the BIOS. Virtualization options are >> enabled. >> >>> SVM is enabled. >> >>> >> >>> I follow the instruction from the FreeBSD handbook ?21.7. FreeBSD as= a >> >>> Host with bhyve?. >> >>> >> >>> When I run >> >>> kldload vmm >> >>> I got an output that SVM is disabled by BIOS. When I check the BIOS = it >> >>> is enabled. >> >>> >> >> >> >> What happens if you load it from /boot/load.conf >> >> >> >> Also you shouldn't have to turn on kvm (I do have it turned on but it >> >> should not be required). >> >> >> >> Bhyve has a upper limit of 16 vm's that it can run at once but I don'= t >> >> think this is based on core count of the processor. >> >> >> >> >> >>> When I try to start the VM with the example script I got the output >> >>> vm_create device not configured >> >>> >> >>> Did I miss something to configure? >> >>> >> >>> Does anyone has a Ryzen CPU and a actual MSI mainboard successfully >> run >> >>> bhyve? >> >>> >> >> >> >> I have two Ryzen 5 2600X/MSI machines as far I can tell looking at th= e >> >> specs (and what I remember when I was deciding to get a 3900X or 2600= X) >> >> there is no practical difference, except for core count, from the >> point of >> >> view of virtualization/bhyve. One machine is a MSI B450 Tomahawk and >> the >> >> other is MSI B450 Gaming Pro. Both machines run bhyve with out any >> >> problem (one of them is my main home office server with 3 vm's on it >> >> [windows and 2 FreeBSD]) and the other is my primary desktop machine >> and >> >> used for R&D on PetiteCloud (which is a web interface to bhyve and >> qemu). >> >> >> >> Best regards >> >>> >> >>> ?Christian >> >>> -- >> >>> -- >> >>> christian jeannot >> >>> vogelmauer 17 >> >>> 86152 augsburg >> >>> +49 821 81552861 >> >>> info@os-plus.org >> >>> _______________________________________________ >> >>> freebsd-virtualization@freebsd.org mailing list >> >>> https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization >> >>> To unsubscribe, send any mail to " >> >>> freebsd-virtualization-unsubscribe@freebsd.org" >> >>> >> >> >> >> >> >> -- >> >> Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org >> >> >> >> >> >> ------------------------------ >> >> >> >> Message: 3 >> >> Date: Sun, 26 Apr 2020 11:56:39 +0200 >> >> From: Christian Jeannot >> >> To: Aryeh Friedman >> >> Cc: freebsd-virtualization@freebsd.org >> >> Subject: Re: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 >> >> Message-ID: >> >> Content-Type: text/plain; charset=3Dutf-8; format=3Dflowed >> >> >> >> >> >> >> >>> Am 26.04.20 um 11:32 schrieb Aryeh Friedman: >> >>> >> >>> >> >>> On Sun, Apr 26, 2020 at 4:57 AM Christian Jeannot > >>> > wrote: >> >>> >> >>> Hi Community, >> >>> >> >>> I am testing bhyve from FreeBSD 12.1 RELEASE. >> >>> >> >>> My environment: >> >>> - CPU: AMD Ryze 3900X >> >>> - Mainboard: MSI MEG ACE X570, Default settings, latest BIOS >> 7C35v18 >> >>> - RAM: G.Skill RipJaws V DIMM Kit 64GB, DDR4-3200, CL16-18-18-38 >> >>> - GPU: Sapphire Nitro RX 5700XT >> >>> >> >>> I checked the settings in the BIOS. Virtualization options are >> enabled. >> >>> SVM is enabled. >> >>> >> >>> I follow the instruction from the FreeBSD handbook ?21.7. FreeBS= D >> as a >> >>> Host with bhyve?. >> >>> >> >>> When I run >> >>> ? ? ?kldload vmm >> >>> I got an output that SVM is disabled by BIOS. When I check the >> BIOS it >> >>> is enabled. >> >>> >> >>> >> >>> What happens if you load it from /boot/load.conf >> >> >> >> When I add >> >> vmm_load=3D"YES" >> >> in /boot/loader.conf I can see the following with dmesg after a reboo= t >> >> >> >> SVM: disabled by BIOS. >> >> module_register_init: MOD_LOAD (vmm, 0xffffffff8264dd20, 0) error 6 >> >> >> >>> >> >>> Also you shouldn't have to turn on kvm (I do have it turned on but i= t >> >>> should not be required). >> >>> >> >>> Bhyve has a upper limit of 16 vm's that it can run at once but I don= 't >> >>> think this is based on core count of the processor. >> >>> >> >>> >> >>> When I try to start the VM with the example script I got the >> output >> >>> ? ? ?vm_create device not configured >> >>> >> >>> Did I miss something to configure? >> >>> >> >>> Does anyone has a Ryzen CPU and a actual MSI mainboard >> successfully run >> >>> bhyve? >> >>> >> >>> >> >>> I have two Ryzen 5 2600X/MSI machines as far I can tell looking at t= he >> >>> specs (and what I remember when I was deciding to get a 3900X or >> 2600X) >> >>> there is no practical difference, except for core count, from the >> point >> >>> of view of virtualization/bhyve.? One machine is a MSI B450 Tomahawk >> and >> >>> the other is MSI B450 Gaming Pro.?? Both machines run bhyve with out >> any >> >>> problem (one of them is my main home office server with 3 vm's on it >> >>> [windows and 2 FreeBSD]) and the other is my primary desktop machine >> and >> >>> used for R&D on PetiteCloud (which is a web interface to bhyve and >> qemu). >> >> >> >> Thank you. Good to know that bhye is working with AMD CPUs, Mainboard= s >> >> and chipsets. >> >> >> >> --Christian >> >> >> >> -- >> >> -- >> >> christian jeannot >> >> vogelmauer 17 >> >> 86152 augsburg >> >> +49 821 81552861 >> >> info@os-plus.org >> >> >> >> >> >> ------------------------------ >> >> >> >> Subject: Digest Footer >> >> >> >> _______________________________________________ >> >> freebsd-virtualization@freebsd.org mailing list >> >> https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization >> >> To unsubscribe, send any mail to " >> freebsd-virtualization-unsubscribe@freebsd.org" >> >> >> >> >> >> ------------------------------ >> >> >> >> End of freebsd-virtualization Digest, Vol 490, Issue 5 >> >> ****************************************************** >> > >> > _______________________________________________ >> > freebsd-virtualization@freebsd.org mailing list >> > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization >> > To unsubscribe, send any mail to " >> freebsd-virtualization-unsubscribe@freebsd.org" >> > >> >> -- >> -- >> christian jeannot >> vogelmauer 17 >> 86152 augsburg >> +49 821 81552861 >> info@os-plus.org >> _______________________________________________ >> freebsd-virtualization@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization >> To unsubscribe, send any mail to " >> freebsd-virtualization-unsubscribe@freebsd.org" >> >