From owner-freebsd-virtualization@freebsd.org Sun Apr 26 08:57:53 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 176B52A8131 for ; Sun, 26 Apr 2020 08:57:53 +0000 (UTC) (envelope-from info@os-plus.org) Received: from mailserv.regfish.com (mailserv.regfish.com [52.57.101.90]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mailserv.regfish.com", Issuer "COMODO RSA Domain Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4991yS0JyQz49jL for ; Sun, 26 Apr 2020 08:57:51 +0000 (UTC) (envelope-from info@os-plus.org) Received: by mailserv.regfish.com (Postfix, from userid 706) id AC5C56135C; Sun, 26 Apr 2020 08:57:50 +0000 (UTC) X-Original-To: freebsd-virtualization@freebsd.org Received: from mbp2016.i.os-plus.de (p2E5E8F7A.dip0.t-ipconnect.de [46.94.143.122]) (using TLSv1.2 with cipher DHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) (Authenticated sender: 40815-0001) by mailserv.regfish.com (Postfix) with ESMTPSA id 9DECE6134A for ; Sun, 26 Apr 2020 08:57:50 +0000 (UTC) To: freebsd-virtualization@freebsd.org From: Christian Jeannot Subject: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 Message-ID: <2535c7f2-ef59-467e-779b-6c9c6db82005@os-plus.org> Date: Sun, 26 Apr 2020 10:57:50 +0200 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Thunderbird/68.7.0 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 4991yS0JyQz49jL X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of info@os-plus.org has no SPF policy when checking 52.57.101.90) smtp.mailfrom=info@os-plus.org X-Spamd-Result: default: False [-1.00 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; NEURAL_HAM_MEDIUM(-0.95)[-0.946,0]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; IP_SCORE(-0.03)[ipnet: 52.57.0.0/16(0.84), asn: 16509(-0.97), country: US(-0.05)]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; TO_DN_NONE(0.00)[]; AUTH_NA(1.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-0.92)[-0.922,0]; RCVD_COUNT_THREE(0.00)[3]; DMARC_NA(0.00)[os-plus.org]; RCVD_IN_DNSWL_NONE(0.00)[90.101.57.52.list.dnswl.org : 127.0.10.0]; R_SPF_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:16509, ipnet:52.57.0.0/16, country:US]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[]; RECEIVED_SPAMHAUS_PBL(0.00)[122.143.94.46.khpj7ygk5idzvmvt5x4ziurxhy.zen.dq.spamhaus.net : 127.0.0.10] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 26 Apr 2020 08:57:53 -0000 Hi Community, I am testing bhyve from FreeBSD 12.1 RELEASE. My environment: - CPU: AMD Ryze 3900X - Mainboard: MSI MEG ACE X570, Default settings, latest BIOS 7C35v18 - RAM: G.Skill RipJaws V DIMM Kit 64GB, DDR4-3200, CL16-18-18-38 - GPU: Sapphire Nitro RX 5700XT I checked the settings in the BIOS. Virtualization options are enabled. SVM is enabled. I follow the instruction from the FreeBSD handbook „21.7. FreeBSD as a Host with bhyve“. When I run kldload vmm I got an output that SVM is disabled by BIOS. When I check the BIOS it is enabled. When I try to start the VM with the example script I got the output vm_create device not configured Did I miss something to configure? Does anyone has a Ryzen CPU and a actual MSI mainboard successfully run bhyve? Best regards —Christian -- -- christian jeannot vogelmauer 17 86152 augsburg +49 821 81552861 info@os-plus.org From owner-freebsd-virtualization@freebsd.org Sun Apr 26 09:32:50 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id F33C52A96CD for ; Sun, 26 Apr 2020 09:32:50 +0000 (UTC) (envelope-from aryeh.friedman@gmail.com) Received: from mail-io1-xd2d.google.com (mail-io1-xd2d.google.com [IPv6:2607:f8b0:4864:20::d2d]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4992kp1LVtz4CX7 for ; Sun, 26 Apr 2020 09:32:49 +0000 (UTC) (envelope-from aryeh.friedman@gmail.com) Received: by mail-io1-xd2d.google.com with SMTP id i19so15590513ioh.12 for ; Sun, 26 Apr 2020 02:32:49 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=/sqFsB6YKVZtwcDgXBcRBvOK5UJUzQdUs4Xjecz1bGc=; b=gpqBA57Bcf2tUIoa2CWoKC7Sds7aX0UU3N3bet0J/Qcp957fN6ZpNqaxfp1CSyP9qa uLQubpNRc6XXxwxVK+Cx56yM9iQjV/0JO8hHWyC1TbyzWoI2sr4gC7Jyw1hngcbQsXrk kI5qaLAbnu9T48bsogIvj60r2O/KxW6C8YjADJabE9FroUtP33aFy9Fy7HuZ2/vW2j/n Lr0yq09Wtnwb5UEGMA4d+5F6qk63Xo09xMRRBkDlquhTwZbPIX78I+rAxh+Dw0wbZ+Zv MndV6tUcS65woP2Z7LumbPUbRmd1mVX2eI5gQzLNEmPXCKYOlOtmX4C1hYlaVvEYreN2 irLQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=/sqFsB6YKVZtwcDgXBcRBvOK5UJUzQdUs4Xjecz1bGc=; b=OfjJ2LNUpKXWrp3h9x6h1nenhGwkve2rHUqPVHr6fLeH8OmNT25zkQel/x/2iyRsQt Y3c3LGCd3XmlQCCCEtrcIFlZnQb6X6OTL4bMOBty5+bXuE495hiAwcQUVjesRr2RobKC yPEXdF0SzNnxRjdEVjotoLtDO4f3fAr2hXx9tDYc/BF/p9XkPh7MXO6vfHNy43wxNxTe EbOHiIJ425aBku6bxwXNNGV8qIa/mlXULwSQNnC3APyPBJMUaiFXZtxmkqhFihLkoRkm YXXXSUy9qBQqngK2v869TWWu1X25U1FBflX+N3Y5mk9CKjuVRfbqlhDvI18wMBZEKx/e 5D9w== X-Gm-Message-State: AGi0Pua2yHYe8tIt2Iq6Gd1F8HRCHQTXgFhJWUyBnaO8p26qbJCLvvfK 1UqEfEEpGmlSnrUyQRm3qgaFL4cLAHLEB82kc92PeM5X X-Google-Smtp-Source: APiQypJbU6umwnBBljp1r9M7BB+om+eDepdIkzvbG4F+dFAurqbqPGr8wla4cj5kPDa80E8GvUKpKoJdD6T++Fv3I8o= X-Received: by 2002:a02:3341:: with SMTP id k1mr16272238jak.74.1587893568769; Sun, 26 Apr 2020 02:32:48 -0700 (PDT) MIME-Version: 1.0 References: <2535c7f2-ef59-467e-779b-6c9c6db82005@os-plus.org> In-Reply-To: <2535c7f2-ef59-467e-779b-6c9c6db82005@os-plus.org> From: Aryeh Friedman Date: Sun, 26 Apr 2020 05:32:36 -0400 Message-ID: Subject: Re: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 To: Christian Jeannot Cc: "freebsd-virtualization@freebsd.org" X-Rspamd-Queue-Id: 4992kp1LVtz4CX7 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=gpqBA57B; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of aryehfriedman@gmail.com designates 2607:f8b0:4864:20::d2d as permitted sender) smtp.mailfrom=aryehfriedman@gmail.com X-Spamd-Result: default: False [-3.00 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; FREEMAIL_FROM(0.00)[gmail.com]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; FROM_EQ_ENVFROM(0.00)[]; IP_SCORE(0.00)[ip: (-7.01), ipnet: 2607:f8b0::/32(-0.33), asn: 15169(-0.43), country: US(-0.05)]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; TAGGED_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; IP_SCORE_FREEMAIL(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[d.2.d.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 26 Apr 2020 09:32:51 -0000 On Sun, Apr 26, 2020 at 4:57 AM Christian Jeannot wrote: > Hi Community, > > I am testing bhyve from FreeBSD 12.1 RELEASE. > > My environment: > - CPU: AMD Ryze 3900X > - Mainboard: MSI MEG ACE X570, Default settings, latest BIOS 7C35v18 > - RAM: G.Skill RipJaws V DIMM Kit 64GB, DDR4-3200, CL16-18-18-38 > - GPU: Sapphire Nitro RX 5700XT > > I checked the settings in the BIOS. Virtualization options are enabled. > SVM is enabled. > > I follow the instruction from the FreeBSD handbook =E2=80=9E21.7. FreeBSD= as a > Host with bhyve=E2=80=9C. > > When I run > kldload vmm > I got an output that SVM is disabled by BIOS. When I check the BIOS it > is enabled. > What happens if you load it from /boot/load.conf Also you shouldn't have to turn on kvm (I do have it turned on but it should not be required). Bhyve has a upper limit of 16 vm's that it can run at once but I don't think this is based on core count of the processor. > When I try to start the VM with the example script I got the output > vm_create device not configured > > Did I miss something to configure? > > Does anyone has a Ryzen CPU and a actual MSI mainboard successfully run > bhyve? > I have two Ryzen 5 2600X/MSI machines as far I can tell looking at the specs (and what I remember when I was deciding to get a 3900X or 2600X) there is no practical difference, except for core count, from the point of view of virtualization/bhyve. One machine is a MSI B450 Tomahawk and the other is MSI B450 Gaming Pro. Both machines run bhyve with out any problem (one of them is my main home office server with 3 vm's on it [windows and 2 FreeBSD]) and the other is my primary desktop machine and used for R&D on PetiteCloud (which is a web interface to bhyve and qemu). Best regards > > =E2=80=94Christian > -- > -- > christian jeannot > vogelmauer 17 > 86152 augsburg > +49 821 81552861 > info@os-plus.org > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to " > freebsd-virtualization-unsubscribe@freebsd.org" > --=20 Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org From owner-freebsd-virtualization@freebsd.org Sun Apr 26 09:56:42 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 51C4D2A9FD8 for ; Sun, 26 Apr 2020 09:56:42 +0000 (UTC) (envelope-from info@os-plus.org) Received: from mailserv.regfish.com (mailserv.regfish.com [52.57.101.90]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mailserv.regfish.com", Issuer "COMODO RSA Domain Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4993GK3Kxcz4DZx for ; Sun, 26 Apr 2020 09:56:41 +0000 (UTC) (envelope-from info@os-plus.org) Received: by mailserv.regfish.com (Postfix, from userid 706) id 5104B612A3; Sun, 26 Apr 2020 09:56:40 +0000 (UTC) X-Original-To: freebsd-virtualization@freebsd.org Received: from mbp2016.i.os-plus.de (p2E5E8F7A.dip0.t-ipconnect.de [46.94.143.122]) (using TLSv1.2 with cipher DHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) (Authenticated sender: 40815-0001) by mailserv.regfish.com (Postfix) with ESMTPSA id 3C7F5612A3; Sun, 26 Apr 2020 09:56:40 +0000 (UTC) Subject: Re: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 To: Aryeh Friedman References: <2535c7f2-ef59-467e-779b-6c9c6db82005@os-plus.org> From: Christian Jeannot Cc: freebsd-virtualization@freebsd.org Message-ID: Date: Sun, 26 Apr 2020 11:56:39 +0200 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Thunderbird/68.7.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 4993GK3Kxcz4DZx X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of info@os-plus.org has no SPF policy when checking 52.57.101.90) smtp.mailfrom=info@os-plus.org X-Spamd-Result: default: False [-1.06 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; NEURAL_HAM_MEDIUM(-0.96)[-0.961,0]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; IP_SCORE(-0.06)[ipnet: 52.57.0.0/16(0.72), asn: 16509(-0.97), country: US(-0.05)]; TAGGED_RCPT(0.00)[]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[os-plus.org]; AUTH_NA(1.00)[]; NEURAL_HAM_LONG(-0.94)[-0.943,0]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[90.101.57.52.list.dnswl.org : 127.0.10.0]; R_SPF_NA(0.00)[]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:16509, ipnet:52.57.0.0/16, country:US]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[]; RECEIVED_SPAMHAUS_PBL(0.00)[122.143.94.46.khpj7ygk5idzvmvt5x4ziurxhy.zen.dq.spamhaus.net : 127.0.0.10] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 26 Apr 2020 09:56:42 -0000 Am 26.04.20 um 11:32 schrieb Aryeh Friedman: > > > On Sun, Apr 26, 2020 at 4:57 AM Christian Jeannot > wrote: > > Hi Community, > > I am testing bhyve from FreeBSD 12.1 RELEASE. > > My environment: > - CPU: AMD Ryze 3900X > - Mainboard: MSI MEG ACE X570, Default settings, latest BIOS 7C35v18 > - RAM: G.Skill RipJaws V DIMM Kit 64GB, DDR4-3200, CL16-18-18-38 > - GPU: Sapphire Nitro RX 5700XT > > I checked the settings in the BIOS. Virtualization options are enabled. > SVM is enabled. > > I follow the instruction from the FreeBSD handbook „21.7. FreeBSD as a > Host with bhyve“. > > When I run >      kldload vmm > I got an output that SVM is disabled by BIOS. When I check the BIOS it > is enabled. > > > What happens if you load it from /boot/load.conf When I add vmm_load="YES" in /boot/loader.conf I can see the following with dmesg after a reboot SVM: disabled by BIOS. module_register_init: MOD_LOAD (vmm, 0xffffffff8264dd20, 0) error 6 > > Also you shouldn't have to turn on kvm (I do have it turned on but it > should not be required). > > Bhyve has a upper limit of 16 vm's that it can run at once but I don't > think this is based on core count of the processor. > > > When I try to start the VM with the example script I got the output >      vm_create device not configured > > Did I miss something to configure? > > Does anyone has a Ryzen CPU and a actual MSI mainboard successfully run > bhyve? > > > I have two Ryzen 5 2600X/MSI machines as far I can tell looking at the > specs (and what I remember when I was deciding to get a 3900X or 2600X) > there is no practical difference, except for core count, from the point > of view of virtualization/bhyve.  One machine is a MSI B450 Tomahawk and > the other is MSI B450 Gaming Pro.   Both machines run bhyve with out any > problem (one of them is my main home office server with 3 vm's on it > [windows and 2 FreeBSD]) and the other is my primary desktop machine and > used for R&D on PetiteCloud (which is a web interface to bhyve and qemu). Thank you. Good to know that bhye is working with AMD CPUs, Mainboards and chipsets. --Christian -- -- christian jeannot vogelmauer 17 86152 augsburg +49 821 81552861 info@os-plus.org From owner-freebsd-virtualization@freebsd.org Sun Apr 26 13:12:02 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id EEDBA2AF83F for ; Sun, 26 Apr 2020 13:12:02 +0000 (UTC) (envelope-from michael.eisenhardt@posteo.de) Received: from mout01.posteo.de (mout01.posteo.de [185.67.36.65]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.posteo.de", Issuer "StartCom Class 3 Primary Intermediate Server CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4997bj4m5xz4T56 for ; Sun, 26 Apr 2020 13:12:01 +0000 (UTC) (envelope-from michael.eisenhardt@posteo.de) Received: from submission (posteo.de [89.146.220.130]) by mout01.posteo.de (Postfix) with ESMTPS id C07CD16005C for ; Sun, 26 Apr 2020 15:11:58 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=posteo.de; s=2017; t=1587906718; bh=3jY4OK4mkhalVWNNAkf+Oht8nwPRxGPEiCR58MMneVg=; h=From:Subject:Date:To:From; b=Ki5dNc0fcGOU+iDGUAJpKQVK5z8MUJRonmLvgU5HW8YKDV8pltT2Mqh40wTXypbij Q1jO9BPiXc/JmzAeUQATQ0owOmNzYqn2RUQGCTBtA3Ray5N3jRjGqAsreDGdS97Zmh BCZAZ8L61M8loR/u9jAyYoCTj7w5mIFcuyApP+bCDZ8w4DyRE9ndHhawHsCHUS0R8j 0X42CujfF/OlKrlNw1fpNn7Adxo6G7Vc82UNwoumIF17fnO10mejetP3FFDmRE3KPJ rKQY5Ljh9afk+BIGprh5xd8wkeAaDxRGNIxY1VIkCU3bAWu3BZnqwfV7YupFAXFoOh UPxmG/eBQXd7Q== Received: from customer (localhost [127.0.0.1]) by submission (posteo.de) with ESMTPSA id 4997bf1Kypz9rxt for ; Sun, 26 Apr 2020 15:11:58 +0200 (CEST) Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable From: "M. Eisenhardt" Mime-Version: 1.0 (1.0) Subject: Re: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 Date: Sun, 26 Apr 2020 15:11:57 +0200 Message-Id: References: In-Reply-To: To: freebsd-virtualization@freebsd.org X-Mailer: iPhone Mail (17F5044d) X-Rspamd-Queue-Id: 4997bj4m5xz4T56 X-Spamd-Bar: ------- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=posteo.de header.s=2017 header.b=Ki5dNc0f; dmarc=pass (policy=none) header.from=posteo.de; spf=pass (mx1.freebsd.org: domain of michael.eisenhardt@posteo.de designates 185.67.36.65 as permitted sender) smtp.mailfrom=michael.eisenhardt@posteo.de X-Spamd-Result: default: False [-7.93 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[posteo.de:s=2017]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:185.67.36.0/23]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; TO_DN_NONE(0.00)[]; RCVD_DKIM_ARC_DNSWL_MED(-0.50)[]; RCPT_COUNT_ONE(0.00)[1]; DWL_DNSWL_LOW(-1.00)[posteo.de.dwl.dnswl.org : 127.0.3.1]; RCVD_COUNT_THREE(0.00)[3]; MV_CASE(0.50)[]; RCVD_IN_DNSWL_MED(-0.20)[65.36.67.185.list.dnswl.org : 127.0.3.2]; DKIM_TRACE(0.00)[posteo.de:+]; DMARC_POLICY_ALLOW(-0.50)[posteo.de,none]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; IP_SCORE(-3.73)[ip: (-9.89), ipnet: 185.67.36.0/23(-4.89), asn: 8495(-3.86), country: DE(-0.02)]; ASN(0.00)[asn:8495, ipnet:185.67.36.0/23, country:DE]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 26 Apr 2020 13:12:03 -0000 I would suggest to update your bios. Kind regards Michael > Am 26.04.2020 um 14:00 schrieb freebsd-virtualization-request@freebsd.org:= >=20 > =EF=BB=BFSend freebsd-virtualization mailing list submissions to > freebsd-virtualization@freebsd.org >=20 > To subscribe or unsubscribe via the World Wide Web, visit > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > or, via email, send a message with subject or body 'help' to > freebsd-virtualization-request@freebsd.org >=20 > You can reach the person managing the list at > freebsd-virtualization-owner@freebsd.org >=20 > When replying, please edit your Subject line so it is more specific > than "Re: Contents of freebsd-virtualization digest..." >=20 >=20 > Today's Topics: >=20 > 1. bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 > (Christian Jeannot) > 2. Re: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 > (Aryeh Friedman) > 3. Re: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 > (Christian Jeannot) >=20 >=20 > ---------------------------------------------------------------------- >=20 > Message: 1 > Date: Sun, 26 Apr 2020 10:57:50 +0200 > From: Christian Jeannot > To: freebsd-virtualization@freebsd.org > Subject: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 > Message-ID: <2535c7f2-ef59-467e-779b-6c9c6db82005@os-plus.org> > Content-Type: text/plain; charset=3Dutf-8; format=3Dflowed >=20 > Hi Community, >=20 > I am testing bhyve from FreeBSD 12.1 RELEASE. >=20 > My environment: > - CPU: AMD Ryze 3900X > - Mainboard: MSI MEG ACE X570, Default settings, latest BIOS 7C35v18 > - RAM: G.Skill RipJaws V DIMM Kit 64GB, DDR4-3200, CL16-18-18-38 > - GPU: Sapphire Nitro RX 5700XT >=20 > I checked the settings in the BIOS. Virtualization options are enabled.=20= > SVM is enabled. >=20 > I follow the instruction from the FreeBSD handbook ?21.7. FreeBSD as a=20 > Host with bhyve?. >=20 > When I run > kldload vmm > I got an output that SVM is disabled by BIOS. When I check the BIOS it=20 > is enabled. >=20 > When I try to start the VM with the example script I got the output > vm_create device not configured >=20 > Did I miss something to configure? >=20 > Does anyone has a Ryzen CPU and a actual MSI mainboard successfully run=20= > bhyve? >=20 > Best regards >=20 > ?Christian > --=20 > -- > christian jeannot > vogelmauer 17 > 86152 augsburg > +49 821 81552861 > info@os-plus.org >=20 >=20 > ------------------------------ >=20 > Message: 2 > Date: Sun, 26 Apr 2020 05:32:36 -0400 > From: Aryeh Friedman > To: Christian Jeannot > Cc: "freebsd-virtualization@freebsd.org" > > Subject: Re: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 > Message-ID: > > Content-Type: text/plain; charset=3D"UTF-8" >=20 >> On Sun, Apr 26, 2020 at 4:57 AM Christian Jeannot wrot= e: >>=20 >> Hi Community, >>=20 >> I am testing bhyve from FreeBSD 12.1 RELEASE. >>=20 >> My environment: >> - CPU: AMD Ryze 3900X >> - Mainboard: MSI MEG ACE X570, Default settings, latest BIOS 7C35v18 >> - RAM: G.Skill RipJaws V DIMM Kit 64GB, DDR4-3200, CL16-18-18-38 >> - GPU: Sapphire Nitro RX 5700XT >>=20 >> I checked the settings in the BIOS. Virtualization options are enabled. >> SVM is enabled. >>=20 >> I follow the instruction from the FreeBSD handbook ?21.7. FreeBSD as a >> Host with bhyve?. >>=20 >> When I run >> kldload vmm >> I got an output that SVM is disabled by BIOS. When I check the BIOS it >> is enabled. >>=20 >=20 > What happens if you load it from /boot/load.conf >=20 > Also you shouldn't have to turn on kvm (I do have it turned on but it > should not be required). >=20 > Bhyve has a upper limit of 16 vm's that it can run at once but I don't > think this is based on core count of the processor. >=20 >=20 >> When I try to start the VM with the example script I got the output >> vm_create device not configured >>=20 >> Did I miss something to configure? >>=20 >> Does anyone has a Ryzen CPU and a actual MSI mainboard successfully run >> bhyve? >>=20 >=20 > I have two Ryzen 5 2600X/MSI machines as far I can tell looking at the > specs (and what I remember when I was deciding to get a 3900X or 2600X) > there is no practical difference, except for core count, from the point of= > view of virtualization/bhyve. One machine is a MSI B450 Tomahawk and the > other is MSI B450 Gaming Pro. Both machines run bhyve with out any > problem (one of them is my main home office server with 3 vm's on it > [windows and 2 FreeBSD]) and the other is my primary desktop machine and > used for R&D on PetiteCloud (which is a web interface to bhyve and qemu). >=20 > Best regards >>=20 >> ?Christian >> -- >> -- >> christian jeannot >> vogelmauer 17 >> 86152 augsburg >> +49 821 81552861 >> info@os-plus.org >> _______________________________________________ >> freebsd-virtualization@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization >> To unsubscribe, send any mail to " >> freebsd-virtualization-unsubscribe@freebsd.org" >>=20 >=20 >=20 > --=20 > Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org >=20 >=20 > ------------------------------ >=20 > Message: 3 > Date: Sun, 26 Apr 2020 11:56:39 +0200 > From: Christian Jeannot > To: Aryeh Friedman > Cc: freebsd-virtualization@freebsd.org > Subject: Re: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 > Message-ID: > Content-Type: text/plain; charset=3Dutf-8; format=3Dflowed >=20 >=20 >=20 >> Am 26.04.20 um 11:32 schrieb Aryeh Friedman: >>=20 >>=20 >> On Sun, Apr 26, 2020 at 4:57 AM Christian Jeannot > > wrote: >>=20 >> Hi Community, >>=20 >> I am testing bhyve from FreeBSD 12.1 RELEASE. >>=20 >> My environment: >> - CPU: AMD Ryze 3900X >> - Mainboard: MSI MEG ACE X570, Default settings, latest BIOS 7C35v18 >> - RAM: G.Skill RipJaws V DIMM Kit 64GB, DDR4-3200, CL16-18-18-38 >> - GPU: Sapphire Nitro RX 5700XT >>=20 >> I checked the settings in the BIOS. Virtualization options are enabled= . >> SVM is enabled. >>=20 >> I follow the instruction from the FreeBSD handbook ?21.7. FreeBSD as a= >> Host with bhyve?. >>=20 >> When I run >> ? ? ?kldload vmm >> I got an output that SVM is disabled by BIOS. When I check the BIOS it= >> is enabled. >>=20 >>=20 >> What happens if you load it from /boot/load.conf >=20 > When I add > vmm_load=3D"YES" > in /boot/loader.conf I can see the following with dmesg after a reboot >=20 > SVM: disabled by BIOS. > module_register_init: MOD_LOAD (vmm, 0xffffffff8264dd20, 0) error 6 >=20 >>=20 >> Also you shouldn't have to turn on kvm (I do have it turned on but it=20 >> should not be required). >>=20 >> Bhyve has a upper limit of 16 vm's that it can run at once but I don't=20= >> think this is based on core count of the processor. >>=20 >>=20 >> When I try to start the VM with the example script I got the output >> ? ? ?vm_create device not configured >>=20 >> Did I miss something to configure? >>=20 >> Does anyone has a Ryzen CPU and a actual MSI mainboard successfully ru= n >> bhyve? >>=20 >>=20 >> I have two Ryzen 5 2600X/MSI machines as far I can tell looking at the=20= >> specs (and what I remember when I was deciding to get a 3900X or 2600X)=20= >> there is no practical difference, except for core count, from the point=20= >> of view of virtualization/bhyve.? One machine is a MSI B450 Tomahawk and=20= >> the other is MSI B450 Gaming Pro.?? Both machines run bhyve with out any=20= >> problem (one of them is my main home office server with 3 vm's on it=20 >> [windows and 2 FreeBSD]) and the other is my primary desktop machine and=20= >> used for R&D on PetiteCloud (which is a web interface to bhyve and qemu).= >=20 > Thank you. Good to know that bhye is working with AMD CPUs, Mainboards=20 > and chipsets. >=20 > --Christian >=20 > --=20 > -- > christian jeannot > vogelmauer 17 > 86152 augsburg > +49 821 81552861 > info@os-plus.org >=20 >=20 > ------------------------------ >=20 > Subject: Digest Footer >=20 > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freeb= sd.org" >=20 >=20 > ------------------------------ >=20 > End of freebsd-virtualization Digest, Vol 490, Issue 5 > ****************************************************** From owner-freebsd-virtualization@freebsd.org Sun Apr 26 13:27:41 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 7EACA2B060B for ; Sun, 26 Apr 2020 13:27:41 +0000 (UTC) (envelope-from info@os-plus.org) Received: from mailserv.regfish.com (mailserv.regfish.com [52.57.101.90]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mailserv.regfish.com", Issuer "COMODO RSA Domain Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4997xm56Tbz4V3B for ; Sun, 26 Apr 2020 13:27:40 +0000 (UTC) (envelope-from info@os-plus.org) Received: by mailserv.regfish.com (Postfix, from userid 706) id 54D5561356; Sun, 26 Apr 2020 13:27:39 +0000 (UTC) X-Original-To: freebsd-virtualization@freebsd.org Received: from mbp2016.i.os-plus.de (p2E5E8F7A.dip0.t-ipconnect.de [46.94.143.122]) (using TLSv1.2 with cipher DHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) (Authenticated sender: 40815-0001) by mailserv.regfish.com (Postfix) with ESMTPSA id 38B6660381 for ; Sun, 26 Apr 2020 13:27:39 +0000 (UTC) Subject: Re: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 To: freebsd-virtualization@freebsd.org References: From: Christian Jeannot Message-ID: Date: Sun, 26 Apr 2020 15:27:38 +0200 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Thunderbird/68.7.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 4997xm56Tbz4V3B X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of info@os-plus.org has no SPF policy when checking 52.57.101.90) smtp.mailfrom=info@os-plus.org X-Spamd-Result: default: False [-0.97 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; NEURAL_HAM_MEDIUM(-0.93)[-0.928,0]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; IP_SCORE(-0.07)[ipnet: 52.57.0.0/16(0.68), asn: 16509(-0.97), country: US(-0.05)]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; TO_DN_NONE(0.00)[]; AUTH_NA(1.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-0.88)[-0.877,0]; RCVD_COUNT_THREE(0.00)[3]; DMARC_NA(0.00)[os-plus.org]; RCVD_IN_DNSWL_NONE(0.00)[90.101.57.52.list.dnswl.org : 127.0.10.0]; R_SPF_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:16509, ipnet:52.57.0.0/16, country:US]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[]; RECEIVED_SPAMHAUS_PBL(0.00)[122.143.94.46.khpj7ygk5idzvmvt5x4ziurxhy.zen.dq.spamhaus.net : 127.0.0.10] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 26 Apr 2020 13:27:41 -0000 I have checked MSI support page. The latest BIOS version is already installed. Regards --Christian Am 26.04.20 um 15:11 schrieb M. Eisenhardt: > I would suggest to update your bios. > Kind regards > Michael > >> Am 26.04.2020 um 14:00 schrieb freebsd-virtualization-request@freebsd.org: >> >> Send freebsd-virtualization mailing list submissions to >> freebsd-virtualization@freebsd.org >> >> To subscribe or unsubscribe via the World Wide Web, visit >> https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization >> or, via email, send a message with subject or body 'help' to >> freebsd-virtualization-request@freebsd.org >> >> You can reach the person managing the list at >> freebsd-virtualization-owner@freebsd.org >> >> When replying, please edit your Subject line so it is more specific >> than "Re: Contents of freebsd-virtualization digest..." >> >> >> Today's Topics: >> >> 1. bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 >> (Christian Jeannot) >> 2. Re: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 >> (Aryeh Friedman) >> 3. Re: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 >> (Christian Jeannot) >> >> >> ---------------------------------------------------------------------- >> >> Message: 1 >> Date: Sun, 26 Apr 2020 10:57:50 +0200 >> From: Christian Jeannot >> To: freebsd-virtualization@freebsd.org >> Subject: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 >> Message-ID: <2535c7f2-ef59-467e-779b-6c9c6db82005@os-plus.org> >> Content-Type: text/plain; charset=utf-8; format=flowed >> >> Hi Community, >> >> I am testing bhyve from FreeBSD 12.1 RELEASE. >> >> My environment: >> - CPU: AMD Ryze 3900X >> - Mainboard: MSI MEG ACE X570, Default settings, latest BIOS 7C35v18 >> - RAM: G.Skill RipJaws V DIMM Kit 64GB, DDR4-3200, CL16-18-18-38 >> - GPU: Sapphire Nitro RX 5700XT >> >> I checked the settings in the BIOS. Virtualization options are enabled. >> SVM is enabled. >> >> I follow the instruction from the FreeBSD handbook ?21.7. FreeBSD as a >> Host with bhyve?. >> >> When I run >> kldload vmm >> I got an output that SVM is disabled by BIOS. When I check the BIOS it >> is enabled. >> >> When I try to start the VM with the example script I got the output >> vm_create device not configured >> >> Did I miss something to configure? >> >> Does anyone has a Ryzen CPU and a actual MSI mainboard successfully run >> bhyve? >> >> Best regards >> >> ?Christian >> -- >> -- >> christian jeannot >> vogelmauer 17 >> 86152 augsburg >> +49 821 81552861 >> info@os-plus.org >> >> >> ------------------------------ >> >> Message: 2 >> Date: Sun, 26 Apr 2020 05:32:36 -0400 >> From: Aryeh Friedman >> To: Christian Jeannot >> Cc: "freebsd-virtualization@freebsd.org" >> >> Subject: Re: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 >> Message-ID: >> >> Content-Type: text/plain; charset="UTF-8" >> >>> On Sun, Apr 26, 2020 at 4:57 AM Christian Jeannot wrote: >>> >>> Hi Community, >>> >>> I am testing bhyve from FreeBSD 12.1 RELEASE. >>> >>> My environment: >>> - CPU: AMD Ryze 3900X >>> - Mainboard: MSI MEG ACE X570, Default settings, latest BIOS 7C35v18 >>> - RAM: G.Skill RipJaws V DIMM Kit 64GB, DDR4-3200, CL16-18-18-38 >>> - GPU: Sapphire Nitro RX 5700XT >>> >>> I checked the settings in the BIOS. Virtualization options are enabled. >>> SVM is enabled. >>> >>> I follow the instruction from the FreeBSD handbook ?21.7. FreeBSD as a >>> Host with bhyve?. >>> >>> When I run >>> kldload vmm >>> I got an output that SVM is disabled by BIOS. When I check the BIOS it >>> is enabled. >>> >> >> What happens if you load it from /boot/load.conf >> >> Also you shouldn't have to turn on kvm (I do have it turned on but it >> should not be required). >> >> Bhyve has a upper limit of 16 vm's that it can run at once but I don't >> think this is based on core count of the processor. >> >> >>> When I try to start the VM with the example script I got the output >>> vm_create device not configured >>> >>> Did I miss something to configure? >>> >>> Does anyone has a Ryzen CPU and a actual MSI mainboard successfully run >>> bhyve? >>> >> >> I have two Ryzen 5 2600X/MSI machines as far I can tell looking at the >> specs (and what I remember when I was deciding to get a 3900X or 2600X) >> there is no practical difference, except for core count, from the point of >> view of virtualization/bhyve. One machine is a MSI B450 Tomahawk and the >> other is MSI B450 Gaming Pro. Both machines run bhyve with out any >> problem (one of them is my main home office server with 3 vm's on it >> [windows and 2 FreeBSD]) and the other is my primary desktop machine and >> used for R&D on PetiteCloud (which is a web interface to bhyve and qemu). >> >> Best regards >>> >>> ?Christian >>> -- >>> -- >>> christian jeannot >>> vogelmauer 17 >>> 86152 augsburg >>> +49 821 81552861 >>> info@os-plus.org >>> _______________________________________________ >>> freebsd-virtualization@freebsd.org mailing list >>> https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization >>> To unsubscribe, send any mail to " >>> freebsd-virtualization-unsubscribe@freebsd.org" >>> >> >> >> -- >> Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org >> >> >> ------------------------------ >> >> Message: 3 >> Date: Sun, 26 Apr 2020 11:56:39 +0200 >> From: Christian Jeannot >> To: Aryeh Friedman >> Cc: freebsd-virtualization@freebsd.org >> Subject: Re: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 >> Message-ID: >> Content-Type: text/plain; charset=utf-8; format=flowed >> >> >> >>> Am 26.04.20 um 11:32 schrieb Aryeh Friedman: >>> >>> >>> On Sun, Apr 26, 2020 at 4:57 AM Christian Jeannot >> > wrote: >>> >>> Hi Community, >>> >>> I am testing bhyve from FreeBSD 12.1 RELEASE. >>> >>> My environment: >>> - CPU: AMD Ryze 3900X >>> - Mainboard: MSI MEG ACE X570, Default settings, latest BIOS 7C35v18 >>> - RAM: G.Skill RipJaws V DIMM Kit 64GB, DDR4-3200, CL16-18-18-38 >>> - GPU: Sapphire Nitro RX 5700XT >>> >>> I checked the settings in the BIOS. Virtualization options are enabled. >>> SVM is enabled. >>> >>> I follow the instruction from the FreeBSD handbook ?21.7. FreeBSD as a >>> Host with bhyve?. >>> >>> When I run >>> ? ? ?kldload vmm >>> I got an output that SVM is disabled by BIOS. When I check the BIOS it >>> is enabled. >>> >>> >>> What happens if you load it from /boot/load.conf >> >> When I add >> vmm_load="YES" >> in /boot/loader.conf I can see the following with dmesg after a reboot >> >> SVM: disabled by BIOS. >> module_register_init: MOD_LOAD (vmm, 0xffffffff8264dd20, 0) error 6 >> >>> >>> Also you shouldn't have to turn on kvm (I do have it turned on but it >>> should not be required). >>> >>> Bhyve has a upper limit of 16 vm's that it can run at once but I don't >>> think this is based on core count of the processor. >>> >>> >>> When I try to start the VM with the example script I got the output >>> ? ? ?vm_create device not configured >>> >>> Did I miss something to configure? >>> >>> Does anyone has a Ryzen CPU and a actual MSI mainboard successfully run >>> bhyve? >>> >>> >>> I have two Ryzen 5 2600X/MSI machines as far I can tell looking at the >>> specs (and what I remember when I was deciding to get a 3900X or 2600X) >>> there is no practical difference, except for core count, from the point >>> of view of virtualization/bhyve.? One machine is a MSI B450 Tomahawk and >>> the other is MSI B450 Gaming Pro.?? Both machines run bhyve with out any >>> problem (one of them is my main home office server with 3 vm's on it >>> [windows and 2 FreeBSD]) and the other is my primary desktop machine and >>> used for R&D on PetiteCloud (which is a web interface to bhyve and qemu). >> >> Thank you. Good to know that bhye is working with AMD CPUs, Mainboards >> and chipsets. >> >> --Christian >> >> -- >> -- >> christian jeannot >> vogelmauer 17 >> 86152 augsburg >> +49 821 81552861 >> info@os-plus.org >> >> >> ------------------------------ >> >> Subject: Digest Footer >> >> _______________________________________________ >> freebsd-virtualization@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization >> To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freebsd.org" >> >> >> ------------------------------ >> >> End of freebsd-virtualization Digest, Vol 490, Issue 5 >> ****************************************************** > > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freebsd.org" > -- -- christian jeannot vogelmauer 17 86152 augsburg +49 821 81552861 info@os-plus.org From owner-freebsd-virtualization@freebsd.org Sun Apr 26 17:53:18 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 0EE092B7AE6 for ; Sun, 26 Apr 2020 17:53:18 +0000 (UTC) (envelope-from eric@vangyzen.net) Received: from smtp.vangyzen.net (hotblack.vangyzen.net [199.48.133.146]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 499FrB4Lkpz3HZW for ; Sun, 26 Apr 2020 17:53:14 +0000 (UTC) (envelope-from eric@vangyzen.net) Received: from disco.vangyzen.net (unknown [70.97.188.230]) by smtp.vangyzen.net (Postfix) with ESMTPSA id AB96456468; Sun, 26 Apr 2020 12:53:06 -0500 (CDT) Subject: Re: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 To: Christian Jeannot , freebsd-virtualization@freebsd.org References: <2535c7f2-ef59-467e-779b-6c9c6db82005@os-plus.org> From: Eric van Gyzen Message-ID: <87c31320-c347-aa1b-adc3-7b36d6edeb38@vangyzen.net> Date: Sun, 26 Apr 2020 12:53:06 -0500 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:68.0) Gecko/20100101 Thunderbird/68.6.0 MIME-Version: 1.0 In-Reply-To: <2535c7f2-ef59-467e-779b-6c9c6db82005@os-plus.org> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 499FrB4Lkpz3HZW X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of eric@vangyzen.net designates 199.48.133.146 as permitted sender) smtp.mailfrom=eric@vangyzen.net X-Spamd-Result: default: False [-5.45 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.999,0]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+a]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[vangyzen.net]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; IP_SCORE(-3.15)[ip: (-8.15), ipnet: 199.48.132.0/22(-3.76), asn: 36236(-3.80), country: US(-0.05)]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:36236, ipnet:199.48.132.0/22, country:US]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 26 Apr 2020 17:53:18 -0000 On 4/26/20 3:57 AM, Christian Jeannot wrote: > Hi Community, > > I am testing bhyve from FreeBSD 12.1 RELEASE. > > My environment: > - CPU: AMD Ryze 3900X > - Mainboard: MSI MEG ACE X570, Default settings, latest BIOS 7C35v18 > - RAM: G.Skill RipJaws V DIMM Kit 64GB, DDR4-3200, CL16-18-18-38 > - GPU: Sapphire Nitro RX 5700XT > > I checked the settings in the BIOS. Virtualization options are enabled. > SVM is enabled. > > I follow the instruction from the FreeBSD handbook „21.7. FreeBSD as a > Host with bhyve“. > > When I run >     kldload vmm > I got an output that SVM is disabled by BIOS. When I check the BIOS it > is enabled. I use bhyve on a Ryzen with an Asus Prime X470-PRO. I wonder if your BIOS is enabling SVM but failing to update the MSR to say it's enabled. Try commenting out the second "return (0);" in svm_available() in sys/amd64/vmm/amd/svm.c and rebuilding the vmm module. If SVM is actually disabled, I have no idea what impact this change will have, so beware. If SVM is actually enabled and this hack allows you to use it, we could probably commit a tunable to do this more cleanly. Eric From owner-freebsd-virtualization@freebsd.org Sun Apr 26 19:12:03 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id A3F492B9D8C for ; Sun, 26 Apr 2020 19:12:03 +0000 (UTC) (envelope-from akgupt3@gmail.com) Received: from mail-wr1-x431.google.com (mail-wr1-x431.google.com [IPv6:2a00:1450:4864:20::431]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 499Hb63WHCz3M7y for ; Sun, 26 Apr 2020 19:12:02 +0000 (UTC) (envelope-from akgupt3@gmail.com) Received: by mail-wr1-x431.google.com with SMTP id f13so17935727wrm.13 for ; Sun, 26 Apr 2020 12:12:02 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=T23g5ThVxkuEBvKTyxHRD3jwJ0FLrHud+H7tjPn2DeU=; b=iVPmOMLeZzkZbKJ/f9nO20lww3afIuZo4ItDmuo52PB6ny/JJUL4TLpfAQpRFiCtyZ K7IhthiHtuaVBZ/xjGqtQUhPimIV4NqMMdTkWJ6zDtGkPjKmFdoNFJ7D6jvnoJPoyfmb gzn2wSimal72VJgFY0XeOCPLzNLM9LvLk4bXvdWej1bjHqwK93hMuryfd9tam2SmmBUQ kwuZpe0id7zHkU+snX+wwSBzXxySAgy5vRJrOU/t4a0uL6qQ0erVz2RhyEKI+kxGlrqT SGMF3UfMd3lFFoj6ZcfxW/luuVCKFyS9UI7KPw0m8+GuhG19dbPcTX9QNwXPj53HBFrq YCbQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=T23g5ThVxkuEBvKTyxHRD3jwJ0FLrHud+H7tjPn2DeU=; b=XyAYZxhbPRTsjo+9eOBpEZUcxACkNXFwzg9a7rXunMIY9CXT8DFFP3OiEiryABUVWu +r8xbG3M2DdLrIEamtkZQ/DiW3vZTZ1lK9FVSIcV86xJNb/WvFBIH8nreP9hk03qp9EL R5WEH8kcQdeu5LkP3r5qB9M6GBsWDYvPeMyS9xbQpGxS1aTEZZsl/BgeSliLL6OhSMbw im7M30izRLs00uqq92DdCrTjQwXB6CsksnHvDilYO+Dwl5hMuQu2rT6FTR8Obr3YPrJr bHkeCPoTn7/mLtCwaTzJtIH6K2xJTtYvJqKS9nBQY5OGuS4AGIoZDacE87pyhHOn2906 ccSA== X-Gm-Message-State: AGi0PuY3LCsht4AclaWb8fZe19Yl4nzd2/k9UslZScDz2RD6dFko/RWQ poLo+t2lHf3nb1CdlCb8UrzGeLO9ocO9nfyCtbo= X-Google-Smtp-Source: APiQypJOzAmYkkrBgTelgWSiyF41lnuxQ/y2xOH/68JQNcWcOB2VEda5IdAhxfLxJSRACWRbAOCnEgPK6CW+WJW3Jl8= X-Received: by 2002:adf:df01:: with SMTP id y1mr23165699wrl.401.1587928320527; Sun, 26 Apr 2020 12:12:00 -0700 (PDT) MIME-Version: 1.0 References: <2535c7f2-ef59-467e-779b-6c9c6db82005@os-plus.org> <87c31320-c347-aa1b-adc3-7b36d6edeb38@vangyzen.net> In-Reply-To: <87c31320-c347-aa1b-adc3-7b36d6edeb38@vangyzen.net> From: Anish Date: Sun, 26 Apr 2020 12:11:49 -0700 Message-ID: Subject: Re: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 To: Eric van Gyzen Cc: Christian Jeannot , "freebsd-virtualization@freebsd.org" X-Rspamd-Queue-Id: 499Hb63WHCz3M7y X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=iVPmOMLe; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of akgupt3@gmail.com designates 2a00:1450:4864:20::431 as permitted sender) smtp.mailfrom=akgupt3@gmail.com X-Spamd-Result: default: False [-2.00 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; FREEMAIL_FROM(0.00)[gmail.com]; URI_COUNT_ODD(1.00)[3]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; FROM_EQ_ENVFROM(0.00)[]; IP_SCORE(0.00)[ip: (-9.04), ipnet: 2a00:1450::/32(-2.33), asn: 15169(-0.43), country: US(-0.05)]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; IP_SCORE_FREEMAIL(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[1.3.4.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.5.4.1.0.0.a.2.list.dnswl.org : 127.0.5.0]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 26 Apr 2020 19:12:03 -0000 >If SVM is actually disabled, I have no idea what impact this change will have, so beware. As per the AMD document, it will cause GP fault if it has been implemented as per specification. If we are lucky and it works, that will be an interesting finding. -Anish On Sun, Apr 26, 2020 at 10:53 AM Eric van Gyzen wrote: > On 4/26/20 3:57 AM, Christian Jeannot wrote: > > Hi Community, > > > > I am testing bhyve from FreeBSD 12.1 RELEASE. > > > > My environment: > > - CPU: AMD Ryze 3900X > > - Mainboard: MSI MEG ACE X570, Default settings, latest BIOS 7C35v18 > > - RAM: G.Skill RipJaws V DIMM Kit 64GB, DDR4-3200, CL16-18-18-38 > > - GPU: Sapphire Nitro RX 5700XT > > > > I checked the settings in the BIOS. Virtualization options are enabled. > > SVM is enabled. > > > > I follow the instruction from the FreeBSD handbook =E2=80=9E21.7. FreeB= SD as a > > Host with bhyve=E2=80=9C. > > > > When I run > > kldload vmm > > I got an output that SVM is disabled by BIOS. When I check the BIOS it > > is enabled. > > I use bhyve on a Ryzen with an Asus Prime X470-PRO. > > I wonder if your BIOS is enabling SVM but failing to update the MSR to > say it's enabled. Try commenting out the second "return (0);" in > svm_available() in sys/amd64/vmm/amd/svm.c and rebuilding the vmm > module. If SVM is actually disabled, I have no idea what impact this > change will have, so beware. If SVM is actually enabled and this hack > allows you to use it, we could probably commit a tunable to do this more > cleanly. > > Eric > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to " > freebsd-virtualization-unsubscribe@freebsd.org" > From owner-freebsd-virtualization@freebsd.org Sun Apr 26 19:26:04 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 26A272BA344 for ; Sun, 26 Apr 2020 19:26:04 +0000 (UTC) (envelope-from akgupt3@gmail.com) Received: from mail-wm1-x336.google.com (mail-wm1-x336.google.com [IPv6:2a00:1450:4864:20::336]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 499HvG67Mxz3Mwq for ; Sun, 26 Apr 2020 19:26:02 +0000 (UTC) (envelope-from akgupt3@gmail.com) Received: by mail-wm1-x336.google.com with SMTP id y24so17981161wma.4 for ; Sun, 26 Apr 2020 12:26:02 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=sYgomIHfjaDs8WNZueXSSZ8qD+TuEfSfiYHrdE/4pX0=; b=GQxUPCVBut4qHZdnAX7YAOcEfVfovIGGU79pvWUOHE7CGbrlF6lfui9GwSvSl53pni uNZq7jOWAHm3HfCX0tFhMnP6OlSRsNLVS9bKYMpOQJK5xoiVB8UhY6impTrL9QvRVBtG ofP+5ryLG4eYmLn33Djuf90GH3XQ6VXhh1bryJstu+FfZptLGZhbJnSWiG5SIR/0wbmf RXVKLM+k11uWC1Z0njxOnGuNLQLQc8nnIaG56M/3AxdJN3N2imtWa1sCmgK+QX8ap85f iB8eADbrtAbwVmoEEq0N7NykCmTXZasKUwOaTbCvxT/otbq4z1TViybjBYV50NcMzTW5 KPRg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=sYgomIHfjaDs8WNZueXSSZ8qD+TuEfSfiYHrdE/4pX0=; b=QUGYJUS4Q4qRwYZt+Z75BM6ZxSTvchSV4fiqWCrItHKhLAP7wjOZOQNcgCgrTy6nwV 5K1keE+kRZ6prMvWx5fDG32lTV8t/w3LXl2siN8zY3TX3tvboaYnGRPstJ9u1OVL+oOc C8kusvArFIFHZDT0FK+TYWX1lkbbmddQO/NKR9LdgNy94ogN1IQzSK4zMN3KOlLUZjk9 AaIwO++X+kUvpaMsstvb1v9BetbcaykznxZ5hQdRq0qqn/PIapySsGnl1fAeaFtJvC0N W/14ElEWfBKWI+1HxCEDDt6mOqYkvONFfI/THiwg9v/jOrb8qU913SEazimG7Pd0ACa4 mNcQ== X-Gm-Message-State: AGi0PuZ1hiNzUlTkQqqFZmeQhhPa6f9Aku1eCZLm3P+E+GkpU3KIF8MW T4hFKuqG9/JUkBn80ldToRlkDoFwNZAIVO5AeY4= X-Google-Smtp-Source: APiQypLwdlKJB7Xh8ge2TkNpNtpRbWW6OhcY3FsNsnUEStRZhTawnlv9PTA8pr0g6VnEiTIClT+6V5uQx1cyvSEoo9o= X-Received: by 2002:a1c:a7d7:: with SMTP id q206mr21196086wme.45.1587929161062; Sun, 26 Apr 2020 12:26:01 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Anish Date: Sun, 26 Apr 2020 12:25:50 -0700 Message-ID: Subject: Re: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 To: Christian Jeannot Cc: "freebsd-virtualization@freebsd.org" X-Rspamd-Queue-Id: 499HvG67Mxz3Mwq X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=GQxUPCVB; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of akgupt3@gmail.com designates 2a00:1450:4864:20::336 as permitted sender) smtp.mailfrom=akgupt3@gmail.com X-Spamd-Result: default: False [-3.00 / 15.00]; ARC_NA(0.00)[]; TO_DN_EQ_ADDR_SOME(0.00)[]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; IP_SCORE_FREEMAIL(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[6.3.3.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.5.4.1.0.0.a.2.list.dnswl.org : 127.0.5.0]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; IP_SCORE(0.00)[ip: (-9.39), ipnet: 2a00:1450::/32(-2.33), asn: 15169(-0.43), country: US(-0.05)]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0] Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 26 Apr 2020 19:26:04 -0000 [Resending without screenshot to reduce message size] Hi Christian, This looks like BIOS issue, BIOS must not set Bit4/SVMDIS in VM_CR MSR (0xC001_0114) if SVM is enabled. Bhyve checks for this bit before enabling SVM otherwise, it can cause GP faults. You can read it using the following steps: $kldload cpuctl $ cpucontrol -m 0xc0010114 /dev/cpuctlX <- Read VM_CR MSR MSR 0xc0010114: 0x00000000 0x00000008 X is any CPU core number. On my AMD/Ryzen system, bit4 is clear and I can load bhyve. -Anish On Sun, Apr 26, 2020 at 6:27 AM Christian Jeannot wrote: > I have checked MSI support page. The latest BIOS version is already > installed. > > Regards > > --Christian > > Am 26.04.20 um 15:11 schrieb M. Eisenhardt: > > I would suggest to update your bios. > > Kind regards > > Michael > > > >> Am 26.04.2020 um 14:00 schrieb > freebsd-virtualization-request@freebsd.org: > >> > >> =EF=BB=BFSend freebsd-virtualization mailing list submissions to > >> freebsd-virtualization@freebsd.org > >> > >> To subscribe or unsubscribe via the World Wide Web, visit > >> https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > >> or, via email, send a message with subject or body 'help' to > >> freebsd-virtualization-request@freebsd.org > >> > >> You can reach the person managing the list at > >> freebsd-virtualization-owner@freebsd.org > >> > >> When replying, please edit your Subject line so it is more specific > >> than "Re: Contents of freebsd-virtualization digest..." > >> > >> > >> Today's Topics: > >> > >> 1. bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 > >> (Christian Jeannot) > >> 2. Re: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 > >> (Aryeh Friedman) > >> 3. Re: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 > >> (Christian Jeannot) > >> > >> > >> ---------------------------------------------------------------------- > >> > >> Message: 1 > >> Date: Sun, 26 Apr 2020 10:57:50 +0200 > >> From: Christian Jeannot > >> To: freebsd-virtualization@freebsd.org > >> Subject: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 > >> Message-ID: <2535c7f2-ef59-467e-779b-6c9c6db82005@os-plus.org> > >> Content-Type: text/plain; charset=3Dutf-8; format=3Dflowed > >> > >> Hi Community, > >> > >> I am testing bhyve from FreeBSD 12.1 RELEASE. > >> > >> My environment: > >> - CPU: AMD Ryze 3900X > >> - Mainboard: MSI MEG ACE X570, Default settings, latest BIOS 7C35v18 > >> - RAM: G.Skill RipJaws V DIMM Kit 64GB, DDR4-3200, CL16-18-18-38 > >> - GPU: Sapphire Nitro RX 5700XT > >> > >> I checked the settings in the BIOS. Virtualization options are enabled= . > >> SVM is enabled. > >> > >> I follow the instruction from the FreeBSD handbook ?21.7. FreeBSD as a > >> Host with bhyve?. > >> > >> When I run > >> kldload vmm > >> I got an output that SVM is disabled by BIOS. When I check the BIOS it > >> is enabled. > >> > >> When I try to start the VM with the example script I got the output > >> vm_create device not configured > >> > >> Did I miss something to configure? > >> > >> Does anyone has a Ryzen CPU and a actual MSI mainboard successfully ru= n > >> bhyve? > >> > >> Best regards > >> > >> ?Christian > >> -- > >> -- > >> christian jeannot > >> vogelmauer 17 > >> 86152 augsburg > >> +49 821 81552861 > >> info@os-plus.org > >> > >> > >> ------------------------------ > >> > >> Message: 2 > >> Date: Sun, 26 Apr 2020 05:32:36 -0400 > >> From: Aryeh Friedman > >> To: Christian Jeannot > >> Cc: "freebsd-virtualization@freebsd.org" > >> > >> Subject: Re: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 > >> Message-ID: > >> > > >> Content-Type: text/plain; charset=3D"UTF-8" > >> > >>> On Sun, Apr 26, 2020 at 4:57 AM Christian Jeannot > wrote: > >>> > >>> Hi Community, > >>> > >>> I am testing bhyve from FreeBSD 12.1 RELEASE. > >>> > >>> My environment: > >>> - CPU: AMD Ryze 3900X > >>> - Mainboard: MSI MEG ACE X570, Default settings, latest BIOS 7C35v18 > >>> - RAM: G.Skill RipJaws V DIMM Kit 64GB, DDR4-3200, CL16-18-18-38 > >>> - GPU: Sapphire Nitro RX 5700XT > >>> > >>> I checked the settings in the BIOS. Virtualization options are enable= d. > >>> SVM is enabled. > >>> > >>> I follow the instruction from the FreeBSD handbook ?21.7. FreeBSD as = a > >>> Host with bhyve?. > >>> > >>> When I run > >>> kldload vmm > >>> I got an output that SVM is disabled by BIOS. When I check the BIOS i= t > >>> is enabled. > >>> > >> > >> What happens if you load it from /boot/load.conf > >> > >> Also you shouldn't have to turn on kvm (I do have it turned on but it > >> should not be required). > >> > >> Bhyve has a upper limit of 16 vm's that it can run at once but I don't > >> think this is based on core count of the processor. > >> > >> > >>> When I try to start the VM with the example script I got the output > >>> vm_create device not configured > >>> > >>> Did I miss something to configure? > >>> > >>> Does anyone has a Ryzen CPU and a actual MSI mainboard successfully r= un > >>> bhyve? > >>> > >> > >> I have two Ryzen 5 2600X/MSI machines as far I can tell looking at the > >> specs (and what I remember when I was deciding to get a 3900X or 2600X= ) > >> there is no practical difference, except for core count, from the poin= t > of > >> view of virtualization/bhyve. One machine is a MSI B450 Tomahawk and > the > >> other is MSI B450 Gaming Pro. Both machines run bhyve with out any > >> problem (one of them is my main home office server with 3 vm's on it > >> [windows and 2 FreeBSD]) and the other is my primary desktop machine a= nd > >> used for R&D on PetiteCloud (which is a web interface to bhyve and > qemu). > >> > >> Best regards > >>> > >>> ?Christian > >>> -- > >>> -- > >>> christian jeannot > >>> vogelmauer 17 > >>> 86152 augsburg > >>> +49 821 81552861 > >>> info@os-plus.org > >>> _______________________________________________ > >>> freebsd-virtualization@freebsd.org mailing list > >>> https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > >>> To unsubscribe, send any mail to " > >>> freebsd-virtualization-unsubscribe@freebsd.org" > >>> > >> > >> > >> -- > >> Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org > >> > >> > >> ------------------------------ > >> > >> Message: 3 > >> Date: Sun, 26 Apr 2020 11:56:39 +0200 > >> From: Christian Jeannot > >> To: Aryeh Friedman > >> Cc: freebsd-virtualization@freebsd.org > >> Subject: Re: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 > >> Message-ID: > >> Content-Type: text/plain; charset=3Dutf-8; format=3Dflowed > >> > >> > >> > >>> Am 26.04.20 um 11:32 schrieb Aryeh Friedman: > >>> > >>> > >>> On Sun, Apr 26, 2020 at 4:57 AM Christian Jeannot >>> > wrote: > >>> > >>> Hi Community, > >>> > >>> I am testing bhyve from FreeBSD 12.1 RELEASE. > >>> > >>> My environment: > >>> - CPU: AMD Ryze 3900X > >>> - Mainboard: MSI MEG ACE X570, Default settings, latest BIOS > 7C35v18 > >>> - RAM: G.Skill RipJaws V DIMM Kit 64GB, DDR4-3200, CL16-18-18-38 > >>> - GPU: Sapphire Nitro RX 5700XT > >>> > >>> I checked the settings in the BIOS. Virtualization options are > enabled. > >>> SVM is enabled. > >>> > >>> I follow the instruction from the FreeBSD handbook ?21.7. FreeBSD > as a > >>> Host with bhyve?. > >>> > >>> When I run > >>> ? ? ?kldload vmm > >>> I got an output that SVM is disabled by BIOS. When I check the > BIOS it > >>> is enabled. > >>> > >>> > >>> What happens if you load it from /boot/load.conf > >> > >> When I add > >> vmm_load=3D"YES" > >> in /boot/loader.conf I can see the following with dmesg after a reboot > >> > >> SVM: disabled by BIOS. > >> module_register_init: MOD_LOAD (vmm, 0xffffffff8264dd20, 0) error 6 > >> > >>> > >>> Also you shouldn't have to turn on kvm (I do have it turned on but it > >>> should not be required). > >>> > >>> Bhyve has a upper limit of 16 vm's that it can run at once but I don'= t > >>> think this is based on core count of the processor. > >>> > >>> > >>> When I try to start the VM with the example script I got the outp= ut > >>> ? ? ?vm_create device not configured > >>> > >>> Did I miss something to configure? > >>> > >>> Does anyone has a Ryzen CPU and a actual MSI mainboard > successfully run > >>> bhyve? > >>> > >>> > >>> I have two Ryzen 5 2600X/MSI machines as far I can tell looking at th= e > >>> specs (and what I remember when I was deciding to get a 3900X or 2600= X) > >>> there is no practical difference, except for core count, from the poi= nt > >>> of view of virtualization/bhyve.? One machine is a MSI B450 Tomahawk > and > >>> the other is MSI B450 Gaming Pro.?? Both machines run bhyve with out > any > >>> problem (one of them is my main home office server with 3 vm's on it > >>> [windows and 2 FreeBSD]) and the other is my primary desktop machine > and > >>> used for R&D on PetiteCloud (which is a web interface to bhyve and > qemu). > >> > >> Thank you. Good to know that bhye is working with AMD CPUs, Mainboards > >> and chipsets. > >> > >> --Christian > >> > >> -- > >> -- > >> christian jeannot > >> vogelmauer 17 > >> 86152 augsburg > >> +49 821 81552861 > >> info@os-plus.org > >> > >> > >> ------------------------------ > >> > >> Subject: Digest Footer > >> > >> _______________________________________________ > >> freebsd-virtualization@freebsd.org mailing list > >> https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > >> To unsubscribe, send any mail to " > freebsd-virtualization-unsubscribe@freebsd.org" > >> > >> > >> ------------------------------ > >> > >> End of freebsd-virtualization Digest, Vol 490, Issue 5 > >> ****************************************************** > > > > _______________________________________________ > > freebsd-virtualization@freebsd.org mailing list > > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > > To unsubscribe, send any mail to " > freebsd-virtualization-unsubscribe@freebsd.org" > > > > -- > -- > christian jeannot > vogelmauer 17 > 86152 augsburg > +49 821 81552861 > info@os-plus.org > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to " > freebsd-virtualization-unsubscribe@freebsd.org" > From owner-freebsd-virtualization@freebsd.org Sun Apr 26 19:33:29 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 9ABED2BA5FE for ; Sun, 26 Apr 2020 19:33:29 +0000 (UTC) (envelope-from aryeh.friedman@gmail.com) Received: from mail-io1-xd2b.google.com (mail-io1-xd2b.google.com [IPv6:2607:f8b0:4864:20::d2b]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 499J3r4SZMz3NJr for ; Sun, 26 Apr 2020 19:33:28 +0000 (UTC) (envelope-from aryeh.friedman@gmail.com) Received: by mail-io1-xd2b.google.com with SMTP id e9so16538698iok.9 for ; Sun, 26 Apr 2020 12:33:28 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=PV8DcR81u2JdCSafTrHsk84LydwtIc5pgJjvlSZYl9Q=; b=nMu75OFbbw5yNI/sZJc6BW4bT7h+vDBOGaxw2gDMymVvia9zfnb7x21YdLfmwxf5qi 5W0PIrOXlNXUVAPOjGx7LMUz8HHiBpLLyFIY33nDPdB3XQB1pwS7RwUkwPUDf1xx3U8d 3lY/Ks/Vb7jmnt+4f5bx3QkWoSqJui09xnzUXkYU5XTzZe9D24SvXOnoJHj2bP77hk/k JzLiWmrwpmgrM6EWkSykdf0V4ltBxs3jHj8kj36A8VDoJYlBMZBeEQ433VrK5ClsiH9x qOJXrMT5rnUi2KbRA57/iKwRv+EojGA/1QuCO/2ELkF7BL+4jJ5iK54WUns1Yib/pKTf KaNA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=PV8DcR81u2JdCSafTrHsk84LydwtIc5pgJjvlSZYl9Q=; b=DNrPXTxfPu55WgUQoGh7gOECrNF5DP4jYAj25CaM4uGeincecydxb3LndPuAbJCpKL 7TxE2ijHI7PpFSDjuQ4/7W64iF5BOgN1FloIiIQLfDSjPHnxfxkzwK2oukX/sZj+c+HL kGSKg9/98H2I34U5Q/aubeH9NKbh4DnUp66vhxkCMX+PX16eR4gIm73D6JcHcJ2MaqrP FpFL/00p2RQGsV7WzVOmkjxGVBE/Z3mPRBx3M5Ne00HERCCv4+QNf8zHfjaI+N4o1AIW xnqb3tpUgn6H/7bbvG3ry+X6TR9NbKideJau9CLixHvq0c/N+iD1l+7T50/kYqWE4pCO wzVA== X-Gm-Message-State: AGi0PuaOqJFq9+Z21e1Vl74ptS15R5wbQxVnehEZSlgTW8kRbsg9pQWe t3Bxcj8hDtQO+ww1daoQwOwy6X+9N8cm3iGCYv0= X-Google-Smtp-Source: APiQypL96cVUz/QriCKWqswzUnbofCj/weXwbkwSSn/7Sz7cR0iEcogAU56W5uPOlxcg/c3l7zr3onnbW6gcCEhdr84= X-Received: by 2002:a5d:85d7:: with SMTP id e23mr18057777ios.174.1587929607555; Sun, 26 Apr 2020 12:33:27 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Aryeh Friedman Date: Sun, 26 Apr 2020 15:33:16 -0400 Message-ID: Subject: Re: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 To: Anish Cc: Christian Jeannot , "freebsd-virtualization@freebsd.org" X-Rspamd-Queue-Id: 499J3r4SZMz3NJr X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=nMu75OFb; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of aryehfriedman@gmail.com designates 2607:f8b0:4864:20::d2b as permitted sender) smtp.mailfrom=aryehfriedman@gmail.com X-Spamd-Result: default: False [-3.00 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; FREEMAIL_FROM(0.00)[gmail.com]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; IP_SCORE(0.00)[ip: (-5.92), ipnet: 2607:f8b0::/32(-0.33), asn: 15169(-0.43), country: US(-0.05)]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; TAGGED_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; IP_SCORE_FREEMAIL(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[b.2.d.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 26 Apr 2020 19:33:29 -0000 On Sun, Apr 26, 2020 at 3:26 PM Anish wrote: > [Resending without screenshot to reduce message size] > > Hi Christian, > > This looks like BIOS issue, BIOS must not set Bit4/SVMDIS in VM_CR MSR > It is likely not a BIOS issue per se because I have a near identical setup and the BIOS (AMI) set stuff correctly (default BIOS settings except for turning on SVM)... From owner-freebsd-virtualization@freebsd.org Sun Apr 26 21:00:26 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 0DD202BC9DC for ; Sun, 26 Apr 2020 21:00:26 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 499L096dTcz3yyx for ; Sun, 26 Apr 2020 21:00:25 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: by mailman.nyi.freebsd.org (Postfix) id E38F72BC9DB; Sun, 26 Apr 2020 21:00:25 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E34FA2BC9DA for ; Sun, 26 Apr 2020 21:00:25 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 499L095mx1z3yyv for ; Sun, 26 Apr 2020 21:00:25 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id C181C270B9 for ; Sun, 26 Apr 2020 21:00:25 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 03QL0Pd7099794 for ; Sun, 26 Apr 2020 21:00:25 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 03QL0PeP099785 for virtualization@FreeBSD.org; Sun, 26 Apr 2020 21:00:25 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202004262100.03QL0PeP099785@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: virtualization@FreeBSD.org Subject: Problem reports for virtualization@FreeBSD.org that need special attention Date: Sun, 26 Apr 2020 21:00:25 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 26 Apr 2020 21:00:26 -0000 To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- New | 240945 | [hyper-v] [netvsc] hn network driver incorrectly Open | 245392 | bhyve: PCI passthru built-in rtl8168 to OpenBSD n 2 problems total for which you should take action. From owner-freebsd-virtualization@freebsd.org Sun Apr 26 19:07:33 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 3130D2B9BB7 for ; Sun, 26 Apr 2020 19:07:33 +0000 (UTC) (envelope-from akgupt3@gmail.com) Received: from mail-wm1-x329.google.com (mail-wm1-x329.google.com [IPv6:2a00:1450:4864:20::329]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 499HTv4sXXz3Ltd for ; Sun, 26 Apr 2020 19:07:31 +0000 (UTC) (envelope-from akgupt3@gmail.com) Received: by mail-wm1-x329.google.com with SMTP id x4so17141791wmj.1 for ; Sun, 26 Apr 2020 12:07:31 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=nbELNPLXmGLuJ/G04YMpZl8et+3sJg28byBm1XWro2w=; b=CPwXUUyNbDxN83hQPxMVYsM1WSApptsIKzgF47eqU/vQmcUAWhNEa9Xf1SU53UmVFW +yuMUEx1XGvHUHfqnG5Y3oUD50W5bncv9kojdzgkp8FrRfLvVtA4N5eTBeBrXEKBV2S4 ETKXCwC68UCbeOMUvghoGtJ3Ojuz8AsH0f1yY0SPLx+CIym0Ja4AmxOvJDYSRRJ0GQ8Q ObsvPRgqkmh17IEtORpTaWStONxna5DcEH3vZoCfkNxCWe2l3GvYn9HxNUe6Gwd4ADBK aokEmSuH8nb/EZXzV8/w1fMwBnUk4SVjafQ/kjBZc6Fqswls+syyiZWaKwPL4T1fprec 2Wpg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=nbELNPLXmGLuJ/G04YMpZl8et+3sJg28byBm1XWro2w=; b=HYk1F4EP0mRFJMhchjV7BQJuTd1RokdYGV1jebjddGhK31h8wUORH7GWKQmbOyMtCm 2Rl/7ZPYdcURHO+gJBy8uc71ORT9q1bsnBg43JHw1J/260HuGSHSQ5Z8dNrnZ6VBiEes bxa8ePgtmPaBcjHJd2jm0NnrpMVXmfkTby/12DQZiDYbLRhrJOsrwQrlNqoheTt/2eIe hu81cWvY3Q3d9fpKa0zyTGvcLDpX5Q5k9wI8a3DFPESqi+/e/X3gOLZ39O9nTU/MgvOC BQBinAxv3N0tWZ06hrOFuL4MupdZX2gfoDKAhaz7H6knYax6w7ZKaMnI6+ZUWF639drC ssDg== X-Gm-Message-State: AGi0PuZ5vUVHmug+DOUy1bv5t3DeHMnSz/xZHpwWpowDSrIt7rEUntwU LmXSDLoJHPKcIUI9KtQo6WsEJLzFsSaKjHF8gfdXOS/PrGX0Dg== X-Google-Smtp-Source: APiQypKTQ1cDfjou3sCj5DS7vBMCwaZvfkScabSIfA7bSJZgPktu+FgYrXpQFLqLEUwIO/Fy3eu9/OB5ak2nNTE2aP8= X-Received: by 2002:a1c:1bcb:: with SMTP id b194mr22890026wmb.4.1587928048334; Sun, 26 Apr 2020 12:07:28 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Anish Date: Sun, 26 Apr 2020 12:07:17 -0700 Message-ID: Subject: Re: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 To: Christian Jeannot Cc: "freebsd-virtualization@freebsd.org" X-Rspamd-Queue-Id: 499HTv4sXXz3Ltd X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=CPwXUUyN; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of akgupt3@gmail.com designates 2a00:1450:4864:20::329 as permitted sender) smtp.mailfrom=akgupt3@gmail.com X-Spamd-Result: default: False [-3.00 / 15.00]; ARC_NA(0.00)[]; TO_DN_EQ_ADDR_SOME(0.00)[]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[multipart/related,multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; IP_SCORE_FREEMAIL(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[9.2.3.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.5.4.1.0.0.a.2.list.dnswl.org : 127.0.5.0]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; IP_SCORE(0.00)[ip: (-9.38), ipnet: 2a00:1450::/32(-2.33), asn: 15169(-0.43), country: US(-0.05)]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:+,3:~,4:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0] X-Mailman-Approved-At: Mon, 27 Apr 2020 06:58:51 +0000 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 26 Apr 2020 19:07:33 -0000 Hi Christian, This looks like BIOS issue, BIOS must not set Bit4/SVMDIS in VM_CR MSR (0xC001_0114) if SVM is enabled. Bhyve checks for this bit before enabling SVM. You can read it using the following steps: $kldload cpuctl $ cpucontrol -m 0xc0010114 /dev/cpuctlX <- Read VM_CR MSR MSR 0xc0010114: 0x00000000 0x00000008 X is any CPU core number. On my AMD/Ryzen system, bit4 is clear and I can load bhyve. I have attached a screenshot from AMD SDM Vol2, which you may find useful. [image: Screen Shot 2020-04-26 at 12.01.14 PM.png] -Anish On Sun, Apr 26, 2020 at 6:27 AM Christian Jeannot wrote: > I have checked MSI support page. The latest BIOS version is already > installed. > > Regards > > --Christian > > Am 26.04.20 um 15:11 schrieb M. Eisenhardt: > > I would suggest to update your bios. > > Kind regards > > Michael > > > >> Am 26.04.2020 um 14:00 schrieb > freebsd-virtualization-request@freebsd.org: > >> > >> =EF=BB=BFSend freebsd-virtualization mailing list submissions to > >> freebsd-virtualization@freebsd.org > >> > >> To subscribe or unsubscribe via the World Wide Web, visit > >> https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > >> or, via email, send a message with subject or body 'help' to > >> freebsd-virtualization-request@freebsd.org > >> > >> You can reach the person managing the list at > >> freebsd-virtualization-owner@freebsd.org > >> > >> When replying, please edit your Subject line so it is more specific > >> than "Re: Contents of freebsd-virtualization digest..." > >> > >> > >> Today's Topics: > >> > >> 1. bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 > >> (Christian Jeannot) > >> 2. Re: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 > >> (Aryeh Friedman) > >> 3. Re: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 > >> (Christian Jeannot) > >> > >> > >> ---------------------------------------------------------------------- > >> > >> Message: 1 > >> Date: Sun, 26 Apr 2020 10:57:50 +0200 > >> From: Christian Jeannot > >> To: freebsd-virtualization@freebsd.org > >> Subject: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 > >> Message-ID: <2535c7f2-ef59-467e-779b-6c9c6db82005@os-plus.org> > >> Content-Type: text/plain; charset=3Dutf-8; format=3Dflowed > >> > >> Hi Community, > >> > >> I am testing bhyve from FreeBSD 12.1 RELEASE. > >> > >> My environment: > >> - CPU: AMD Ryze 3900X > >> - Mainboard: MSI MEG ACE X570, Default settings, latest BIOS 7C35v18 > >> - RAM: G.Skill RipJaws V DIMM Kit 64GB, DDR4-3200, CL16-18-18-38 > >> - GPU: Sapphire Nitro RX 5700XT > >> > >> I checked the settings in the BIOS. Virtualization options are enabled= . > >> SVM is enabled. > >> > >> I follow the instruction from the FreeBSD handbook ?21.7. FreeBSD as a > >> Host with bhyve?. > >> > >> When I run > >> kldload vmm > >> I got an output that SVM is disabled by BIOS. When I check the BIOS it > >> is enabled. > >> > >> When I try to start the VM with the example script I got the output > >> vm_create device not configured > >> > >> Did I miss something to configure? > >> > >> Does anyone has a Ryzen CPU and a actual MSI mainboard successfully ru= n > >> bhyve? > >> > >> Best regards > >> > >> ?Christian > >> -- > >> -- > >> christian jeannot > >> vogelmauer 17 > >> 86152 augsburg > >> +49 821 81552861 > >> info@os-plus.org > >> > >> > >> ------------------------------ > >> > >> Message: 2 > >> Date: Sun, 26 Apr 2020 05:32:36 -0400 > >> From: Aryeh Friedman > >> To: Christian Jeannot > >> Cc: "freebsd-virtualization@freebsd.org" > >> > >> Subject: Re: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 > >> Message-ID: > >> > > >> Content-Type: text/plain; charset=3D"UTF-8" > >> > >>> On Sun, Apr 26, 2020 at 4:57 AM Christian Jeannot > wrote: > >>> > >>> Hi Community, > >>> > >>> I am testing bhyve from FreeBSD 12.1 RELEASE. > >>> > >>> My environment: > >>> - CPU: AMD Ryze 3900X > >>> - Mainboard: MSI MEG ACE X570, Default settings, latest BIOS 7C35v18 > >>> - RAM: G.Skill RipJaws V DIMM Kit 64GB, DDR4-3200, CL16-18-18-38 > >>> - GPU: Sapphire Nitro RX 5700XT > >>> > >>> I checked the settings in the BIOS. Virtualization options are enable= d. > >>> SVM is enabled. > >>> > >>> I follow the instruction from the FreeBSD handbook ?21.7. FreeBSD as = a > >>> Host with bhyve?. > >>> > >>> When I run > >>> kldload vmm > >>> I got an output that SVM is disabled by BIOS. When I check the BIOS i= t > >>> is enabled. > >>> > >> > >> What happens if you load it from /boot/load.conf > >> > >> Also you shouldn't have to turn on kvm (I do have it turned on but it > >> should not be required). > >> > >> Bhyve has a upper limit of 16 vm's that it can run at once but I don't > >> think this is based on core count of the processor. > >> > >> > >>> When I try to start the VM with the example script I got the output > >>> vm_create device not configured > >>> > >>> Did I miss something to configure? > >>> > >>> Does anyone has a Ryzen CPU and a actual MSI mainboard successfully r= un > >>> bhyve? > >>> > >> > >> I have two Ryzen 5 2600X/MSI machines as far I can tell looking at the > >> specs (and what I remember when I was deciding to get a 3900X or 2600X= ) > >> there is no practical difference, except for core count, from the poin= t > of > >> view of virtualization/bhyve. One machine is a MSI B450 Tomahawk and > the > >> other is MSI B450 Gaming Pro. Both machines run bhyve with out any > >> problem (one of them is my main home office server with 3 vm's on it > >> [windows and 2 FreeBSD]) and the other is my primary desktop machine a= nd > >> used for R&D on PetiteCloud (which is a web interface to bhyve and > qemu). > >> > >> Best regards > >>> > >>> ?Christian > >>> -- > >>> -- > >>> christian jeannot > >>> vogelmauer 17 > >>> 86152 augsburg > >>> +49 821 81552861 > >>> info@os-plus.org > >>> _______________________________________________ > >>> freebsd-virtualization@freebsd.org mailing list > >>> https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > >>> To unsubscribe, send any mail to " > >>> freebsd-virtualization-unsubscribe@freebsd.org" > >>> > >> > >> > >> -- > >> Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org > >> > >> > >> ------------------------------ > >> > >> Message: 3 > >> Date: Sun, 26 Apr 2020 11:56:39 +0200 > >> From: Christian Jeannot > >> To: Aryeh Friedman > >> Cc: freebsd-virtualization@freebsd.org > >> Subject: Re: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 > >> Message-ID: > >> Content-Type: text/plain; charset=3Dutf-8; format=3Dflowed > >> > >> > >> > >>> Am 26.04.20 um 11:32 schrieb Aryeh Friedman: > >>> > >>> > >>> On Sun, Apr 26, 2020 at 4:57 AM Christian Jeannot >>> > wrote: > >>> > >>> Hi Community, > >>> > >>> I am testing bhyve from FreeBSD 12.1 RELEASE. > >>> > >>> My environment: > >>> - CPU: AMD Ryze 3900X > >>> - Mainboard: MSI MEG ACE X570, Default settings, latest BIOS > 7C35v18 > >>> - RAM: G.Skill RipJaws V DIMM Kit 64GB, DDR4-3200, CL16-18-18-38 > >>> - GPU: Sapphire Nitro RX 5700XT > >>> > >>> I checked the settings in the BIOS. Virtualization options are > enabled. > >>> SVM is enabled. > >>> > >>> I follow the instruction from the FreeBSD handbook ?21.7. FreeBSD > as a > >>> Host with bhyve?. > >>> > >>> When I run > >>> ? ? ?kldload vmm > >>> I got an output that SVM is disabled by BIOS. When I check the > BIOS it > >>> is enabled. > >>> > >>> > >>> What happens if you load it from /boot/load.conf > >> > >> When I add > >> vmm_load=3D"YES" > >> in /boot/loader.conf I can see the following with dmesg after a reboot > >> > >> SVM: disabled by BIOS. > >> module_register_init: MOD_LOAD (vmm, 0xffffffff8264dd20, 0) error 6 > >> > >>> > >>> Also you shouldn't have to turn on kvm (I do have it turned on but it > >>> should not be required). > >>> > >>> Bhyve has a upper limit of 16 vm's that it can run at once but I don'= t > >>> think this is based on core count of the processor. > >>> > >>> > >>> When I try to start the VM with the example script I got the outp= ut > >>> ? ? ?vm_create device not configured > >>> > >>> Did I miss something to configure? > >>> > >>> Does anyone has a Ryzen CPU and a actual MSI mainboard > successfully run > >>> bhyve? > >>> > >>> > >>> I have two Ryzen 5 2600X/MSI machines as far I can tell looking at th= e > >>> specs (and what I remember when I was deciding to get a 3900X or 2600= X) > >>> there is no practical difference, except for core count, from the poi= nt > >>> of view of virtualization/bhyve.? One machine is a MSI B450 Tomahawk > and > >>> the other is MSI B450 Gaming Pro.?? Both machines run bhyve with out > any > >>> problem (one of them is my main home office server with 3 vm's on it > >>> [windows and 2 FreeBSD]) and the other is my primary desktop machine > and > >>> used for R&D on PetiteCloud (which is a web interface to bhyve and > qemu). > >> > >> Thank you. Good to know that bhye is working with AMD CPUs, Mainboards > >> and chipsets. > >> > >> --Christian > >> > >> -- > >> -- > >> christian jeannot > >> vogelmauer 17 > >> 86152 augsburg > >> +49 821 81552861 > >> info@os-plus.org > >> > >> > >> ------------------------------ > >> > >> Subject: Digest Footer > >> > >> _______________________________________________ > >> freebsd-virtualization@freebsd.org mailing list > >> https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > >> To unsubscribe, send any mail to " > freebsd-virtualization-unsubscribe@freebsd.org" > >> > >> > >> ------------------------------ > >> > >> End of freebsd-virtualization Digest, Vol 490, Issue 5 > >> ****************************************************** > > > > _______________________________________________ > > freebsd-virtualization@freebsd.org mailing list > > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > > To unsubscribe, send any mail to " > freebsd-virtualization-unsubscribe@freebsd.org" > > > > -- > -- > christian jeannot > vogelmauer 17 > 86152 augsburg > +49 821 81552861 > info@os-plus.org > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to " > freebsd-virtualization-unsubscribe@freebsd.org" > From owner-freebsd-virtualization@freebsd.org Mon Apr 27 07:22:10 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8AD8B2ABCA5 for ; Mon, 27 Apr 2020 07:22:10 +0000 (UTC) (envelope-from aryeh.friedman@gmail.com) Received: from mail-il1-x12b.google.com (mail-il1-x12b.google.com [IPv6:2607:f8b0:4864:20::12b]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 499bnY40c1z4Y6b for ; Mon, 27 Apr 2020 07:22:09 +0000 (UTC) (envelope-from aryeh.friedman@gmail.com) Received: by mail-il1-x12b.google.com with SMTP id c18so483773ile.5 for ; Mon, 27 Apr 2020 00:22:09 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=rZE00p0+OTjhutuDsj+C7x4puKSOA8DoiPcladpBvmg=; b=EcTtI7n6sG1lKLMyr9F/eLgxI6HvJku2SF6z9iX5x3/AUigFyAciHMBUH4i+4knz+9 L4Ktt33Ooe3Lxq3q+bf54rWmd1lnc0dHKL2u42igEGZYc8a6rggOfZlIYCYYrDi9p4BX AolRv1pWb/v5aAPFuM6m522rDrcyWMe4baWd5E8Apo4jzycw9bEy5E7TM7Fh3ViIJs1B KeH+Wtl/15yPclYSPmV+MyyPKLMEDLuZHAwopDly/qwwYfsKc1wVyNHkUeYdMkEh6OkK iT+J9dv5L5WXaKbB4Jf7B8j16qSsoRVSfOOLJWW3zeXanz553hh3HmKByk9U2+TkE2/H cH6w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=rZE00p0+OTjhutuDsj+C7x4puKSOA8DoiPcladpBvmg=; b=Et53wgmSCc7B0pm4jEgIbQu1Qiwy4nJ99ap+ZYteon6WEG1X25a5qxNAoaisiRBZFz 6NCFGA3NcwkjBohijsq2t4CCRd2nXB2LZ7PVgc+PV7phTirhZWRGKiijKH9aDInAhQDR OUJEzgXytbPu5rMjp93ql95Jagdu+J2ZE+vRACRFUnvjDnzeoqBGjuTqW/SwppEJ7yZa Vc8lF0nds47g/hyb/RIlvngN8C5VJ12/tLaIUUXOOixPuLzGVtUstwb4+w81YNs2Y8MV /QvsDEB7yUTMFbzVqyy5MwanPWSAH4CL3ymwk3NDWWPXLrP6eFs69LqhR8iv5tQCZKoB VdMg== X-Gm-Message-State: AGi0PuZIQoFfzKCSSjI6E8ZgOziO7KfDCj3/u9HUM9VF9AOmUY6GH3Yh RlNHQEHAe9Y0VZK9o8HMzVRITLbRo4Vf7ynRcfGJgQ7vipw= X-Google-Smtp-Source: APiQypLXgQmL1WA2+NNwTv9V406tuxEn65An570FH5TvstYYX93EK8mZknTJXI8Fcc4QlEBZIL43s7rTSiG7hipnSsA= X-Received: by 2002:a92:d186:: with SMTP id z6mr19138255ilz.119.1587972127914; Mon, 27 Apr 2020 00:22:07 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Aryeh Friedman Date: Mon, 27 Apr 2020 03:21:56 -0400 Message-ID: Subject: Re: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 To: Anish Cc: Christian Jeannot , "freebsd-virtualization@freebsd.org" X-Rspamd-Queue-Id: 499bnY40c1z4Y6b X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=EcTtI7n6; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of aryehfriedman@gmail.com designates 2607:f8b0:4864:20::12b as permitted sender) smtp.mailfrom=aryehfriedman@gmail.com X-Spamd-Result: default: False [-3.00 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; FREEMAIL_FROM(0.00)[gmail.com]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; IP_SCORE(0.00)[ip: (-7.76), ipnet: 2607:f8b0::/32(-0.33), asn: 15169(-0.43), country: US(-0.05)]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; TAGGED_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; IP_SCORE_FREEMAIL(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[b.2.1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Apr 2020 07:22:10 -0000 On Mon, Apr 27, 2020 at 2:58 AM Anish wrote: > Hi Christian, > > This looks like BIOS issue, BIOS must not set Bit4/SVMDIS in VM_CR MSR > (0xC001_0114) if SVM is enabled. Bhyve checks for this bit before > enabling SVM. You can read it using the following steps: > $kldload cpuctl > > > $ cpucontrol -m 0xc0010114 /dev/cpuctlX <- Read VM_CR MSR > MSR 0xc0010114: 0x00000000 0x00000008 > > X is any CPU core number. > Again it is likely not a BIOS issues since the OP and me have nearly identical setups (same MB manufacturer/same product line for both the CPU and MB as well the same BIOS in most likely hood) and I get the following (which works): root@neomarx:~ # kldload cpuctl root@neomarx:~ # cpucontrol -m 0xc0010114 /dev/cpuctl0 MSR 0xc0010114: 0x00000000 0x00000008 My BIOS: 7C02v1D 2019-11-11 OP BIOS: 7C35v18 2020-01-16 So if anything his should work and mine not work. @OP do you have IOMMU support on or to auto (that is the one possible setting you didn't state in your initial post -- mine is auto) > > On my AMD/Ryzen system, bit4 is clear and I can load bhyve. I have attach= ed > a screenshot from AMD SDM Vol2, which you may find useful. > > [image: Screen Shot 2020-04-26 at 12.01.14 PM.png] > > -Anish > > > > On Sun, Apr 26, 2020 at 6:27 AM Christian Jeannot > wrote: > > > I have checked MSI support page. The latest BIOS version is already > > installed. > > > > Regards > > > > --Christian > > > > Am 26.04.20 um 15:11 schrieb M. Eisenhardt: > > > I would suggest to update your bios. > > > Kind regards > > > Michael > > > > > >> Am 26.04.2020 um 14:00 schrieb > > freebsd-virtualization-request@freebsd.org: > > >> > > >> =EF=BB=BFSend freebsd-virtualization mailing list submissions to > > >> freebsd-virtualization@freebsd.org > > >> > > >> To subscribe or unsubscribe via the World Wide Web, visit > > >> https://lists.freebsd.org/mailman/listinfo/freebsd-virtualizatio= n > > >> or, via email, send a message with subject or body 'help' to > > >> freebsd-virtualization-request@freebsd.org > > >> > > >> You can reach the person managing the list at > > >> freebsd-virtualization-owner@freebsd.org > > >> > > >> When replying, please edit your Subject line so it is more specific > > >> than "Re: Contents of freebsd-virtualization digest..." > > >> > > >> > > >> Today's Topics: > > >> > > >> 1. bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 > > >> (Christian Jeannot) > > >> 2. Re: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 > > >> (Aryeh Friedman) > > >> 3. Re: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 > > >> (Christian Jeannot) > > >> > > >> > > >> --------------------------------------------------------------------= -- > > >> > > >> Message: 1 > > >> Date: Sun, 26 Apr 2020 10:57:50 +0200 > > >> From: Christian Jeannot > > >> To: freebsd-virtualization@freebsd.org > > >> Subject: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 > > >> Message-ID: <2535c7f2-ef59-467e-779b-6c9c6db82005@os-plus.org> > > >> Content-Type: text/plain; charset=3Dutf-8; format=3Dflowed > > >> > > >> Hi Community, > > >> > > >> I am testing bhyve from FreeBSD 12.1 RELEASE. > > >> > > >> My environment: > > >> - CPU: AMD Ryze 3900X > > >> - Mainboard: MSI MEG ACE X570, Default settings, latest BIOS 7C35v18 > > >> - RAM: G.Skill RipJaws V DIMM Kit 64GB, DDR4-3200, CL16-18-18-38 > > >> - GPU: Sapphire Nitro RX 5700XT > > >> > > >> I checked the settings in the BIOS. Virtualization options are > enabled. > > >> SVM is enabled. > > >> > > >> I follow the instruction from the FreeBSD handbook ?21.7. FreeBSD as= a > > >> Host with bhyve?. > > >> > > >> When I run > > >> kldload vmm > > >> I got an output that SVM is disabled by BIOS. When I check the BIOS = it > > >> is enabled. > > >> > > >> When I try to start the VM with the example script I got the output > > >> vm_create device not configured > > >> > > >> Did I miss something to configure? > > >> > > >> Does anyone has a Ryzen CPU and a actual MSI mainboard successfully > run > > >> bhyve? > > >> > > >> Best regards > > >> > > >> ?Christian > > >> -- > > >> -- > > >> christian jeannot > > >> vogelmauer 17 > > >> 86152 augsburg > > >> +49 821 81552861 > > >> info@os-plus.org > > >> > > >> > > >> ------------------------------ > > >> > > >> Message: 2 > > >> Date: Sun, 26 Apr 2020 05:32:36 -0400 > > >> From: Aryeh Friedman > > >> To: Christian Jeannot > > >> Cc: "freebsd-virtualization@freebsd.org" > > >> > > >> Subject: Re: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 > > >> Message-ID: > > >> bx7oJAEmKsXigUbhf-9wrw@mail.gmail.com > > > > > >> Content-Type: text/plain; charset=3D"UTF-8" > > >> > > >>> On Sun, Apr 26, 2020 at 4:57 AM Christian Jeannot > > wrote: > > >>> > > >>> Hi Community, > > >>> > > >>> I am testing bhyve from FreeBSD 12.1 RELEASE. > > >>> > > >>> My environment: > > >>> - CPU: AMD Ryze 3900X > > >>> - Mainboard: MSI MEG ACE X570, Default settings, latest BIOS 7C35v1= 8 > > >>> - RAM: G.Skill RipJaws V DIMM Kit 64GB, DDR4-3200, CL16-18-18-38 > > >>> - GPU: Sapphire Nitro RX 5700XT > > >>> > > >>> I checked the settings in the BIOS. Virtualization options are > enabled. > > >>> SVM is enabled. > > >>> > > >>> I follow the instruction from the FreeBSD handbook ?21.7. FreeBSD a= s > a > > >>> Host with bhyve?. > > >>> > > >>> When I run > > >>> kldload vmm > > >>> I got an output that SVM is disabled by BIOS. When I check the BIOS > it > > >>> is enabled. > > >>> > > >> > > >> What happens if you load it from /boot/load.conf > > >> > > >> Also you shouldn't have to turn on kvm (I do have it turned on but i= t > > >> should not be required). > > >> > > >> Bhyve has a upper limit of 16 vm's that it can run at once but I don= 't > > >> think this is based on core count of the processor. > > >> > > >> > > >>> When I try to start the VM with the example script I got the output > > >>> vm_create device not configured > > >>> > > >>> Did I miss something to configure? > > >>> > > >>> Does anyone has a Ryzen CPU and a actual MSI mainboard successfully > run > > >>> bhyve? > > >>> > > >> > > >> I have two Ryzen 5 2600X/MSI machines as far I can tell looking at t= he > > >> specs (and what I remember when I was deciding to get a 3900X or > 2600X) > > >> there is no practical difference, except for core count, from the > point > > of > > >> view of virtualization/bhyve. One machine is a MSI B450 Tomahawk an= d > > the > > >> other is MSI B450 Gaming Pro. Both machines run bhyve with out any > > >> problem (one of them is my main home office server with 3 vm's on it > > >> [windows and 2 FreeBSD]) and the other is my primary desktop machine > and > > >> used for R&D on PetiteCloud (which is a web interface to bhyve and > > qemu). > > >> > > >> Best regards > > >>> > > >>> ?Christian > > >>> -- > > >>> -- > > >>> christian jeannot > > >>> vogelmauer 17 > > >>> 86152 augsburg > > >>> +49 821 81552861 > > >>> info@os-plus.org > > >>> _______________________________________________ > > >>> freebsd-virtualization@freebsd.org mailing list > > >>> https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > > >>> To unsubscribe, send any mail to " > > >>> freebsd-virtualization-unsubscribe@freebsd.org" > > >>> > > >> > > >> > > >> -- > > >> Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org > > >> > > >> > > >> ------------------------------ > > >> > > >> Message: 3 > > >> Date: Sun, 26 Apr 2020 11:56:39 +0200 > > >> From: Christian Jeannot > > >> To: Aryeh Friedman > > >> Cc: freebsd-virtualization@freebsd.org > > >> Subject: Re: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 > > >> Message-ID: > > >> Content-Type: text/plain; charset=3Dutf-8; format=3Dflowed > > >> > > >> > > >> > > >>> Am 26.04.20 um 11:32 schrieb Aryeh Friedman: > > >>> > > >>> > > >>> On Sun, Apr 26, 2020 at 4:57 AM Christian Jeannot > >>> > wrote: > > >>> > > >>> Hi Community, > > >>> > > >>> I am testing bhyve from FreeBSD 12.1 RELEASE. > > >>> > > >>> My environment: > > >>> - CPU: AMD Ryze 3900X > > >>> - Mainboard: MSI MEG ACE X570, Default settings, latest BIOS > > 7C35v18 > > >>> - RAM: G.Skill RipJaws V DIMM Kit 64GB, DDR4-3200, CL16-18-18-3= 8 > > >>> - GPU: Sapphire Nitro RX 5700XT > > >>> > > >>> I checked the settings in the BIOS. Virtualization options are > > enabled. > > >>> SVM is enabled. > > >>> > > >>> I follow the instruction from the FreeBSD handbook ?21.7. FreeB= SD > > as a > > >>> Host with bhyve?. > > >>> > > >>> When I run > > >>> ? ? ?kldload vmm > > >>> I got an output that SVM is disabled by BIOS. When I check the > > BIOS it > > >>> is enabled. > > >>> > > >>> > > >>> What happens if you load it from /boot/load.conf > > >> > > >> When I add > > >> vmm_load=3D"YES" > > >> in /boot/loader.conf I can see the following with dmesg after a rebo= ot > > >> > > >> SVM: disabled by BIOS. > > >> module_register_init: MOD_LOAD (vmm, 0xffffffff8264dd20, 0) error 6 > > >> > > >>> > > >>> Also you shouldn't have to turn on kvm (I do have it turned on but = it > > >>> should not be required). > > >>> > > >>> Bhyve has a upper limit of 16 vm's that it can run at once but I > don't > > >>> think this is based on core count of the processor. > > >>> > > >>> > > >>> When I try to start the VM with the example script I got the > output > > >>> ? ? ?vm_create device not configured > > >>> > > >>> Did I miss something to configure? > > >>> > > >>> Does anyone has a Ryzen CPU and a actual MSI mainboard > > successfully run > > >>> bhyve? > > >>> > > >>> > > >>> I have two Ryzen 5 2600X/MSI machines as far I can tell looking at > the > > >>> specs (and what I remember when I was deciding to get a 3900X or > 2600X) > > >>> there is no practical difference, except for core count, from the > point > > >>> of view of virtualization/bhyve.? One machine is a MSI B450 Tomahaw= k > > and > > >>> the other is MSI B450 Gaming Pro.?? Both machines run bhyve with ou= t > > any > > >>> problem (one of them is my main home office server with 3 vm's on i= t > > >>> [windows and 2 FreeBSD]) and the other is my primary desktop machin= e > > and > > >>> used for R&D on PetiteCloud (which is a web interface to bhyve and > > qemu). > > >> > > >> Thank you. Good to know that bhye is working with AMD CPUs, Mainboar= ds > > >> and chipsets. > > >> > > >> --Christian > > >> > > >> -- > > >> -- > > >> christian jeannot > > >> vogelmauer 17 > > >> 86152 augsburg > > >> +49 821 81552861 > > >> info@os-plus.org > > >> > > >> > > >> ------------------------------ > > >> > > >> Subject: Digest Footer > > >> > > >> _______________________________________________ > > >> freebsd-virtualization@freebsd.org mailing list > > >> https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > > >> To unsubscribe, send any mail to " > > freebsd-virtualization-unsubscribe@freebsd.org" > > >> > > >> > > >> ------------------------------ > > >> > > >> End of freebsd-virtualization Digest, Vol 490, Issue 5 > > >> ****************************************************** > > > > > > _______________________________________________ > > > freebsd-virtualization@freebsd.org mailing list > > > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > > > To unsubscribe, send any mail to " > > freebsd-virtualization-unsubscribe@freebsd.org" > > > > > > > -- > > -- > > christian jeannot > > vogelmauer 17 > > 86152 augsburg > > +49 821 81552861 > > info@os-plus.org > > _______________________________________________ > > freebsd-virtualization@freebsd.org mailing list > > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > > To unsubscribe, send any mail to " > > freebsd-virtualization-unsubscribe@freebsd.org" > > > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to " > freebsd-virtualization-unsubscribe@freebsd.org" > --=20 Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org From owner-freebsd-virtualization@freebsd.org Mon Apr 27 09:14:23 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id BC5DB2B037A for ; Mon, 27 Apr 2020 09:14:23 +0000 (UTC) (envelope-from info@os-plus.org) Received: from mailserv.regfish.com (mailserv.regfish.com [52.57.101.90]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mailserv.regfish.com", Issuer "COMODO RSA Domain Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 499fH14dmzz3D4j for ; Mon, 27 Apr 2020 09:14:21 +0000 (UTC) (envelope-from info@os-plus.org) Received: by mailserv.regfish.com (Postfix, from userid 706) id AD04A613BD; Mon, 27 Apr 2020 09:14:19 +0000 (UTC) X-Original-To: freebsd-virtualization@freebsd.org Received: from mbp2016.i.os-plus.de (p2E5E8F7A.dip0.t-ipconnect.de [46.94.143.122]) (using TLSv1.2 with cipher DHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) (Authenticated sender: 40815-0001) by mailserv.regfish.com (Postfix) with ESMTPSA id 954F5612BF; Mon, 27 Apr 2020 09:14:19 +0000 (UTC) Subject: Re: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 To: Henrik Gulbrandsen References: <2535c7f2-ef59-467e-779b-6c9c6db82005@os-plus.org> <4fb12456563000903fd06d79982b4397@www.gulbra.net> Cc: freebsd-virtualization@freebsd.org From: Christian Jeannot Message-ID: <93316af9-28f1-5c06-7878-813c3b409219@os-plus.org> Date: Mon, 27 Apr 2020 11:14:18 +0200 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Thunderbird/68.7.0 MIME-Version: 1.0 In-Reply-To: <4fb12456563000903fd06d79982b4397@www.gulbra.net> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 499fH14dmzz3D4j X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of info@os-plus.org has no SPF policy when checking 52.57.101.90) smtp.mailfrom=info@os-plus.org X-Spamd-Result: default: False [-1.08 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; NEURAL_HAM_MEDIUM(-0.96)[-0.957,0]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; IP_SCORE(-0.08)[ipnet: 52.57.0.0/16(0.63), asn: 16509(-0.97), country: US(-0.05)]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[os-plus.org]; AUTH_NA(1.00)[]; NEURAL_HAM_LONG(-0.94)[-0.943,0]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[90.101.57.52.list.dnswl.org : 127.0.10.0]; R_SPF_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:16509, ipnet:52.57.0.0/16, country:US]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[]; RECEIVED_SPAMHAUS_PBL(0.00)[122.143.94.46.khpj7ygk5idzvmvt5x4ziurxhy.zen.dq.spamhaus.net : 127.0.0.10] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Apr 2020 09:14:23 -0000 Hello Henrik, many thanks for your information. I have checked the MSI forum entry. They say that the information about SVM in the overclocking section could be wrong. As I do not see this value somewhere else where I can configure it it seems to me that this output in this BIOS part is not correct. I will try to find a way to confogure SVM in the BIOS or contact MSI about that. Regards --Christian Am 26.04.20 um 19:06 schrieb Henrik Gulbrandsen: > On 2020-04-26 10:57, Christian Jeannot wrote: >> I checked the settings in the BIOS. Virtualization options are >> enabled. SVM is enabled. > > I don't want to speculate publically, but I think you may be wrong > about this. After reading the source code (sys/amd64/vmm/amd/svm.c), > the "AMD64 Architecture Programmer's Manual", and the web, it looks > like this is definitely a bit set by the BIOS to disable SVM. > > I don't have your particular motherboard, or even an AMD CPU, but > these links might be helpful: > >     https://bugzilla.redhat.com/show_bug.cgi?id=1456273 >     https://forum-en.msi.com/index.php?topic=287179 > > The last forum comment was for a different motherboard, but: > >    "Note that the info in the OC menu in the BIOS (Overclocking\ >     CPU Specification\CPU Technology Support\Secure Virtual Machine >     shows enabled, even when it is not!" > > There is little I can do to debug your problem, but I thought > this might just possibly help a little anyway. > > Good luck! > > /Henrik > -- -- christian jeannot vogelmauer 17 86152 augsburg +49 821 81552861 info@os-plus.org From owner-freebsd-virtualization@freebsd.org Mon Apr 27 09:17:13 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 745772B04D6 for ; Mon, 27 Apr 2020 09:17:13 +0000 (UTC) (envelope-from info@os-plus.org) Received: from mailserv.regfish.com (mailserv.regfish.com [52.57.101.90]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mailserv.regfish.com", Issuer "COMODO RSA Domain Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 499fLJ4kkrz3DBj for ; Mon, 27 Apr 2020 09:17:12 +0000 (UTC) (envelope-from info@os-plus.org) Received: by mailserv.regfish.com (Postfix, from userid 706) id 9CD8A613BD; Mon, 27 Apr 2020 09:17:11 +0000 (UTC) X-Original-To: freebsd-virtualization@freebsd.org Received: from mbp2016.i.os-plus.de (p2E5E8F7A.dip0.t-ipconnect.de [46.94.143.122]) (using TLSv1.2 with cipher DHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) (Authenticated sender: 40815-0001) by mailserv.regfish.com (Postfix) with ESMTPSA id 8748A61397; Mon, 27 Apr 2020 09:17:11 +0000 (UTC) Subject: Re: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 To: Eric van Gyzen References: <2535c7f2-ef59-467e-779b-6c9c6db82005@os-plus.org> <87c31320-c347-aa1b-adc3-7b36d6edeb38@vangyzen.net> Cc: freebsd-virtualization@freebsd.org From: Christian Jeannot Message-ID: Date: Mon, 27 Apr 2020 11:17:10 +0200 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Thunderbird/68.7.0 MIME-Version: 1.0 In-Reply-To: <87c31320-c347-aa1b-adc3-7b36d6edeb38@vangyzen.net> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 499fLJ4kkrz3DBj X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of info@os-plus.org has no SPF policy when checking 52.57.101.90) smtp.mailfrom=info@os-plus.org X-Spamd-Result: default: False [-1.08 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; NEURAL_HAM_MEDIUM(-0.97)[-0.965,0]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; IP_SCORE(-0.08)[ipnet: 52.57.0.0/16(0.60), asn: 16509(-0.97), country: US(-0.05)]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[os-plus.org]; AUTH_NA(1.00)[]; NEURAL_HAM_LONG(-0.93)[-0.932,0]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[90.101.57.52.list.dnswl.org : 127.0.10.0]; R_SPF_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:16509, ipnet:52.57.0.0/16, country:US]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[]; RECEIVED_SPAMHAUS_PBL(0.00)[122.143.94.46.khpj7ygk5idzvmvt5x4ziurxhy.zen.dq.spamhaus.net : 127.0.0.10] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Apr 2020 09:17:13 -0000 Hello Eric, thank you for your information. I will first check if I can find a way in the BIOS to configure SVM. Fromy my point of view MSI should provie a BIOS where it is possible to configure this option. If this does not work I will look for your hint. Regards --Christian Am 26.04.20 um 19:53 schrieb Eric van Gyzen: > On 4/26/20 3:57 AM, Christian Jeannot wrote: >> Hi Community, >> >> I am testing bhyve from FreeBSD 12.1 RELEASE. >> >> My environment: >> - CPU: AMD Ryze 3900X >> - Mainboard: MSI MEG ACE X570, Default settings, latest BIOS 7C35v18 >> - RAM: G.Skill RipJaws V DIMM Kit 64GB, DDR4-3200, CL16-18-18-38 >> - GPU: Sapphire Nitro RX 5700XT >> >> I checked the settings in the BIOS. Virtualization options are >> enabled. SVM is enabled. >> >> I follow the instruction from the FreeBSD handbook „21.7. FreeBSD as a >> Host with bhyve“. >> >> When I run >>      kldload vmm >> I got an output that SVM is disabled by BIOS. When I check the BIOS it >> is enabled. > > I use bhyve on a Ryzen with an Asus Prime X470-PRO. > > I wonder if your BIOS is enabling SVM but failing to update the MSR to > say it's enabled.  Try commenting out the second "return (0);" in > svm_available() in sys/amd64/vmm/amd/svm.c and rebuilding the vmm > module.  If SVM is actually disabled, I have no idea what impact this > change will have, so beware.  If SVM is actually enabled and this hack > allows you to use it, we could probably commit a tunable to do this more > cleanly. > > Eric -- -- christian jeannot vogelmauer 17 86152 augsburg +49 821 81552861 info@os-plus.org From owner-freebsd-virtualization@freebsd.org Mon Apr 27 09:22:47 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 64FB12B073E for ; Mon, 27 Apr 2020 09:22:47 +0000 (UTC) (envelope-from info@os-plus.org) Received: from mailserv.regfish.com (mailserv.regfish.com [52.57.101.90]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mailserv.regfish.com", Issuer "COMODO RSA Domain Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 499fSk5D4kz3DX9 for ; Mon, 27 Apr 2020 09:22:46 +0000 (UTC) (envelope-from info@os-plus.org) Received: by mailserv.regfish.com (Postfix, from userid 706) id A12F560342; Mon, 27 Apr 2020 09:22:45 +0000 (UTC) X-Original-To: freebsd-virtualization@freebsd.org Received: from mbp2016.i.os-plus.de (p2E5E8F7A.dip0.t-ipconnect.de [46.94.143.122]) (using TLSv1.2 with cipher DHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) (Authenticated sender: 40815-0001) by mailserv.regfish.com (Postfix) with ESMTPSA id 84C2460342; Mon, 27 Apr 2020 09:22:45 +0000 (UTC) Subject: Re: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 To: Anish Cc: "freebsd-virtualization@freebsd.org" References: From: Christian Jeannot Message-ID: Date: Mon, 27 Apr 2020 11:22:44 +0200 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Thunderbird/68.7.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 499fSk5D4kz3DX9 X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of info@os-plus.org has no SPF policy when checking 52.57.101.90) smtp.mailfrom=info@os-plus.org X-Spamd-Result: default: False [-1.13 / 15.00]; ARC_NA(0.00)[]; TO_DN_EQ_ADDR_SOME(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; NEURAL_HAM_MEDIUM(-0.97)[-0.972,0]; IP_SCORE(-0.09)[ipnet: 52.57.0.0/16(0.56), asn: 16509(-0.97), country: US(-0.05)]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[os-plus.org]; AUTH_NA(1.00)[]; NEURAL_HAM_LONG(-0.97)[-0.967,0]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[90.101.57.52.list.dnswl.org : 127.0.10.0]; R_SPF_NA(0.00)[]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:16509, ipnet:52.57.0.0/16, country:US]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[]; RECEIVED_SPAMHAUS_PBL(0.00)[122.143.94.46.khpj7ygk5idzvmvt5x4ziurxhy.zen.dq.spamhaus.net : 127.0.0.10] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Apr 2020 09:22:47 -0000 Hello Anish, thank you for your information. Executing cpucontrol -m 0xc0010114 /dev/cpuctl0 or cpucontrol -m 0xc0010114 /dev/cpuctl1 I got MSR 0xc0010114: 0x00000000 0x00000018 Regards --Christian Am 26.04.20 um 21:07 schrieb Anish: > cpucontrol -m 0xc0010114 /dev/cpuctl -- -- christian jeannot vogelmauer 17 86152 augsburg +49 821 81552861 info@os-plus.org From owner-freebsd-virtualization@freebsd.org Mon Apr 27 09:34:30 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id F30402B0D52 for ; Mon, 27 Apr 2020 09:34:30 +0000 (UTC) (envelope-from info@os-plus.org) Received: from mailserv.regfish.com (mailserv.regfish.com [52.57.101.90]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mailserv.regfish.com", Issuer "COMODO RSA Domain Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 499fkG23Nnz3FFw for ; Mon, 27 Apr 2020 09:34:30 +0000 (UTC) (envelope-from info@os-plus.org) Received: by mailserv.regfish.com (Postfix, from userid 706) id 3450961397; Mon, 27 Apr 2020 09:34:29 +0000 (UTC) X-Original-To: freebsd-virtualization@freebsd.org Received: from mbp2016.i.os-plus.de (p2E5E8F7A.dip0.t-ipconnect.de [46.94.143.122]) (using TLSv1.2 with cipher DHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) (Authenticated sender: 40815-0001) by mailserv.regfish.com (Postfix) with ESMTPSA id F1CC761357; Mon, 27 Apr 2020 09:34:28 +0000 (UTC) Subject: Re: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 To: Aryeh Friedman , Anish Cc: "freebsd-virtualization@freebsd.org" References: From: Christian Jeannot Message-ID: <91b223a6-62d7-023f-d268-d6a2e7ded2e8@os-plus.org> Date: Mon, 27 Apr 2020 11:34:27 +0200 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Thunderbird/68.7.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 499fkG23Nnz3FFw X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of info@os-plus.org has no SPF policy when checking 52.57.101.90) smtp.mailfrom=info@os-plus.org X-Spamd-Result: default: False [-1.10 / 15.00]; ARC_NA(0.00)[]; TO_DN_EQ_ADDR_SOME(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; TO_DN_SOME(0.00)[]; IP_SCORE(-0.10)[ipnet: 52.57.0.0/16(0.53), asn: 16509(-0.96), country: US(-0.05)]; TAGGED_RCPT(0.00)[]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[os-plus.org]; AUTH_NA(1.00)[]; NEURAL_HAM_LONG(-0.97)[-0.969,0]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[90.101.57.52.list.dnswl.org : 127.0.10.0]; NEURAL_HAM_MEDIUM(-0.94)[-0.939,0]; R_SPF_NA(0.00)[]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:16509, ipnet:52.57.0.0/16, country:US]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Apr 2020 09:34:31 -0000 Hello Aryeh, Hello @All, I ´was able to switch the Expert mode in the Overclocking/CPU Features section from the BIOS. After this I was abel to see the real settings from IOMMU and SVM. IOMMU is on Auto SVM is disabled. I have enabled SVM, saved the settings and booted the system. vmm is loaded with no error message. I even do not see any entry from vmm in dmesg. When I run kldstat I can see that vmm is loaded. Executing cpucontrol -m 0xc0010114 /dev/cpuctl0 or cpucontrol -m 0xc0010114 /dev/cpuctl1 gives now MSR 0xc0010114: 0x00000000 0x00000008 From my point this looks good and should be solved now so I can continue. I say many thanks to this list and to all people who assisted. Best regards --Christian Am 27.04.20 um 09:21 schrieb Aryeh Friedman: > > > On Mon, Apr 27, 2020 at 2:58 AM Anish > wrote: > > Hi Christian, > > This looks like BIOS issue, BIOS must not set Bit4/SVMDIS in VM_CR MSR > (0xC001_0114) if SVM is enabled. Bhyve checks for this bit before > enabling SVM. You can read it using the following steps: > $kldload cpuctl > > > $ cpucontrol -m 0xc0010114 /dev/cpuctlX <- Read VM_CR MSR > MSR 0xc0010114: 0x00000000 0x00000008 > > X is any CPU core number. > > > Again it is likely not a BIOS issues since the OP and me have nearly > identical setups (same MB manufacturer/same product line for both the > CPU and MB as well the same BIOS in most likely hood) and I get the > following (which works): > > root@neomarx:~ # kldload cpuctl > root@neomarx:~ # cpucontrol -m 0xc0010114 /dev/cpuctl0 > MSR 0xc0010114: 0x00000000 0x00000008 > > My BIOS: 7C02v1D 2019-11-11 > OP BIOS: 7C35v18 2020-01-16 > > So if anything his should work and mine not work. > > @OP do you have IOMMU support on or to auto (that is the one possible > setting you didn't state in your initial post -- mine is auto) > > > On my AMD/Ryzen system, bit4 is clear and I can load bhyve. I have > attached > a screenshot from AMD SDM Vol2, which you may find useful. > > [image: Screen Shot 2020-04-26 at 12.01.14 PM.png] > > -Anish > > > > On Sun, Apr 26, 2020 at 6:27 AM Christian Jeannot > wrote: > > > I have checked MSI support page. The latest BIOS version is already > > installed. > > > > Regards > > > > --Christian > > > > Am 26.04.20 um 15:11 schrieb M. Eisenhardt: > > > I would suggest to update your bios. > > > Kind regards > > > Michael > > > > > >> Am 26.04.2020 um 14:00 schrieb > > freebsd-virtualization-request@freebsd.org > : > > >> > > >> Send freebsd-virtualization mailing list submissions to > > >> freebsd-virtualization@freebsd.org > > > >> > > >> To subscribe or unsubscribe via the World Wide Web, visit > > >> https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > > >> or, via email, send a message with subject or body 'help' to > > >> freebsd-virtualization-request@freebsd.org > > > >> > > >> You can reach the person managing the list at > > >> freebsd-virtualization-owner@freebsd.org > > > >> > > >> When replying, please edit your Subject line so it is more > specific > > >> than "Re: Contents of freebsd-virtualization digest..." > > >> > > >> > > >> Today's Topics: > > >> > > >>    1. bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 > > >>       (Christian Jeannot) > > >>    2. Re: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 > > >>       (Aryeh Friedman) > > >>    3. Re: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 > > >>       (Christian Jeannot) > > >> > > >> > > >> > ---------------------------------------------------------------------- > > >> > > >> Message: 1 > > >> Date: Sun, 26 Apr 2020 10:57:50 +0200 > > >> From: Christian Jeannot > > > >> To: freebsd-virtualization@freebsd.org > > > >> Subject: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 > > >> Message-ID: <2535c7f2-ef59-467e-779b-6c9c6db82005@os-plus.org > > > > >> Content-Type: text/plain; charset=utf-8; format=flowed > > >> > > >> Hi Community, > > >> > > >> I am testing bhyve from FreeBSD 12.1 RELEASE. > > >> > > >> My environment: > > >> - CPU: AMD Ryze 3900X > > >> - Mainboard: MSI MEG ACE X570, Default settings, latest BIOS > 7C35v18 > > >> - RAM: G.Skill RipJaws V DIMM Kit 64GB, DDR4-3200, CL16-18-18-38 > > >> - GPU: Sapphire Nitro RX 5700XT > > >> > > >> I checked the settings in the BIOS. Virtualization options are > enabled. > > >> SVM is enabled. > > >> > > >> I follow the instruction from the FreeBSD handbook ?21.7. > FreeBSD as a > > >> Host with bhyve?. > > >> > > >> When I run > > >>      kldload vmm > > >> I got an output that SVM is disabled by BIOS. When I check the > BIOS it > > >> is enabled. > > >> > > >> When I try to start the VM with the example script I got the > output > > >>      vm_create device not configured > > >> > > >> Did I miss something to configure? > > >> > > >> Does anyone has a Ryzen CPU and a actual MSI mainboard > successfully run > > >> bhyve? > > >> > > >> Best regards > > >> > > >> ?Christian > > >> -- > > >> -- > > >> christian jeannot > > >> vogelmauer 17 > > >> 86152 augsburg > > >> +49 821 81552861 > > >> info@os-plus.org > > >> > > >> > > >> ------------------------------ > > >> > > >> Message: 2 > > >> Date: Sun, 26 Apr 2020 05:32:36 -0400 > > >> From: Aryeh Friedman > > > >> To: Christian Jeannot > > > >> Cc: "freebsd-virtualization@freebsd.org > " > > >>      > > > >> Subject: Re: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 > > >> Message-ID: > > >> >   > > > > > >> Content-Type: text/plain; charset="UTF-8" > > >> > > >>> On Sun, Apr 26, 2020 at 4:57 AM Christian Jeannot > > > > wrote: > > >>> > > >>> Hi Community, > > >>> > > >>> I am testing bhyve from FreeBSD 12.1 RELEASE. > > >>> > > >>> My environment: > > >>> - CPU: AMD Ryze 3900X > > >>> - Mainboard: MSI MEG ACE X570, Default settings, latest BIOS > 7C35v18 > > >>> - RAM: G.Skill RipJaws V DIMM Kit 64GB, DDR4-3200, CL16-18-18-38 > > >>> - GPU: Sapphire Nitro RX 5700XT > > >>> > > >>> I checked the settings in the BIOS. Virtualization options > are enabled. > > >>> SVM is enabled. > > >>> > > >>> I follow the instruction from the FreeBSD handbook ?21.7. > FreeBSD as a > > >>> Host with bhyve?. > > >>> > > >>> When I run > > >>>      kldload vmm > > >>> I got an output that SVM is disabled by BIOS. When I check > the BIOS it > > >>> is enabled. > > >>> > > >> > > >> What happens if you load it from /boot/load.conf > > >> > > >> Also you shouldn't have to turn on kvm (I do have it turned on > but it > > >> should not be required). > > >> > > >> Bhyve has a upper limit of 16 vm's that it can run at once but > I don't > > >> think this is based on core count of the processor. > > >> > > >> > > >>> When I try to start the VM with the example script I got the > output > > >>>      vm_create device not configured > > >>> > > >>> Did I miss something to configure? > > >>> > > >>> Does anyone has a Ryzen CPU and a actual MSI mainboard > successfully run > > >>> bhyve? > > >>> > > >> > > >> I have two Ryzen 5 2600X/MSI machines as far I can tell > looking at the > > >> specs (and what I remember when I was deciding to get a 3900X > or 2600X) > > >> there is no practical difference, except for core count, from > the point > > of > > >> view of virtualization/bhyve.  One machine is a MSI B450 > Tomahawk and > > the > > >> other is MSI B450 Gaming Pro.   Both machines run bhyve with > out any > > >> problem (one of them is my main home office server with 3 vm's > on it > > >> [windows and 2 FreeBSD]) and the other is my primary desktop > machine and > > >> used for R&D on PetiteCloud (which is a web interface to bhyve and > > qemu). > > >> > > >> Best regards > > >>> > > >>> ?Christian > > >>> -- > > >>> -- > > >>> christian jeannot > > >>> vogelmauer 17 > > >>> 86152 augsburg > > >>> +49 821 81552861 > > >>> info@os-plus.org > > >>> _______________________________________________ > > >>> freebsd-virtualization@freebsd.org > mailing list > > >>> https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > > >>> To unsubscribe, send any mail to " > > >>> freebsd-virtualization-unsubscribe@freebsd.org > " > > >>> > > >> > > >> > > >> -- > > >> Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org > > >> > > >> > > >> ------------------------------ > > >> > > >> Message: 3 > > >> Date: Sun, 26 Apr 2020 11:56:39 +0200 > > >> From: Christian Jeannot > > > >> To: Aryeh Friedman > > > >> Cc: freebsd-virtualization@freebsd.org > > > >> Subject: Re: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 > > >> Message-ID: > > > >> Content-Type: text/plain; charset=utf-8; format=flowed > > >> > > >> > > >> > > >>> Am 26.04.20 um 11:32 schrieb Aryeh Friedman: > > >>> > > >>> > > >>> On Sun, Apr 26, 2020 at 4:57 AM Christian Jeannot > > > >>> >> wrote: > > >>> > > >>>     Hi Community, > > >>> > > >>>     I am testing bhyve from FreeBSD 12.1 RELEASE. > > >>> > > >>>     My environment: > > >>>     - CPU: AMD Ryze 3900X > > >>>     - Mainboard: MSI MEG ACE X570, Default settings, latest BIOS > > 7C35v18 > > >>>     - RAM: G.Skill RipJaws V DIMM Kit 64GB, DDR4-3200, > CL16-18-18-38 > > >>>     - GPU: Sapphire Nitro RX 5700XT > > >>> > > >>>     I checked the settings in the BIOS. Virtualization > options are > > enabled. > > >>>     SVM is enabled. > > >>> > > >>>     I follow the instruction from the FreeBSD handbook ?21.7. > FreeBSD > > as a > > >>>     Host with bhyve?. > > >>> > > >>>     When I run > > >>>      ? ? ?kldload vmm > > >>>     I got an output that SVM is disabled by BIOS. When I > check the > > BIOS it > > >>>     is enabled. > > >>> > > >>> > > >>> What happens if you load it from /boot/load.conf > > >> > > >> When I add > > >>     vmm_load="YES" > > >> in /boot/loader.conf I can see the following with dmesg after > a reboot > > >> > > >> SVM: disabled by BIOS. > > >> module_register_init: MOD_LOAD (vmm, 0xffffffff8264dd20, 0) > error 6 > > >> > > >>> > > >>> Also you shouldn't have to turn on kvm (I do have it turned > on but it > > >>> should not be required). > > >>> > > >>> Bhyve has a upper limit of 16 vm's that it can run at once > but I don't > > >>> think this is based on core count of the processor. > > >>> > > >>> > > >>>     When I try to start the VM with the example script I got > the output > > >>>      ? ? ?vm_create device not configured > > >>> > > >>>     Did I miss something to configure? > > >>> > > >>>     Does anyone has a Ryzen CPU and a actual MSI mainboard > > successfully run > > >>>     bhyve? > > >>> > > >>> > > >>> I have two Ryzen 5 2600X/MSI machines as far I can tell > looking at the > > >>> specs (and what I remember when I was deciding to get a 3900X > or 2600X) > > >>> there is no practical difference, except for core count, from > the point > > >>> of view of virtualization/bhyve.? One machine is a MSI B450 > Tomahawk > > and > > >>> the other is MSI B450 Gaming Pro.?? Both machines run bhyve > with out > > any > > >>> problem (one of them is my main home office server with 3 > vm's on it > > >>> [windows and 2 FreeBSD]) and the other is my primary desktop > machine > > and > > >>> used for R&D on PetiteCloud (which is a web interface to > bhyve and > > qemu). > > >> > > >> Thank you. Good to know that bhye is working with AMD CPUs, > Mainboards > > >> and chipsets. > > >> > > >> --Christian > > >> > > >> -- > > >> -- > > >> christian jeannot > > >> vogelmauer 17 > > >> 86152 augsburg > > >> +49 821 81552861 > > >> info@os-plus.org > > >> > > >> > > >> ------------------------------ > > >> > > >> Subject: Digest Footer > > >> > > >> _______________________________________________ > > >> freebsd-virtualization@freebsd.org > mailing list > > >> https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > > >> To unsubscribe, send any mail to " > > freebsd-virtualization-unsubscribe@freebsd.org > " > > >> > > >> > > >> ------------------------------ > > >> > > >> End of freebsd-virtualization Digest, Vol 490, Issue 5 > > >> ****************************************************** > > > > > > _______________________________________________ > > > freebsd-virtualization@freebsd.org > mailing list > > > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > > > To unsubscribe, send any mail to " > > freebsd-virtualization-unsubscribe@freebsd.org > " > > > > > > > -- > > -- > > christian jeannot > > vogelmauer 17 > > 86152 augsburg > > +49 821 81552861 > > info@os-plus.org > > _______________________________________________ > > freebsd-virtualization@freebsd.org > mailing list > > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > > To unsubscribe, send any mail to " > > freebsd-virtualization-unsubscribe@freebsd.org > " > > > _______________________________________________ > freebsd-virtualization@freebsd.org > mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to > "freebsd-virtualization-unsubscribe@freebsd.org > " > > > > -- > Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org -- -- christian jeannot vogelmauer 17 86152 augsburg +49 821 81552861 info@os-plus.org From owner-freebsd-virtualization@freebsd.org Sun Apr 26 19:16:20 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id B9E172BA00A for ; Sun, 26 Apr 2020 19:16:20 +0000 (UTC) (envelope-from akgupt3@gmail.com) Received: from mail-wm1-x32e.google.com (mail-wm1-x32e.google.com [IPv6:2a00:1450:4864:20::32e]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 499Hh25zDnz3MQh for ; Sun, 26 Apr 2020 19:16:18 +0000 (UTC) (envelope-from akgupt3@gmail.com) Received: by mail-wm1-x32e.google.com with SMTP id x4so17159128wmj.1 for ; Sun, 26 Apr 2020 12:16:18 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=ZDHFA90z7UuaWpfw84+jGthrSDkvxGJhthls85QXW70=; b=AIgh20k6/rNdOgrXOL9A1fMxdZ+zAS/Xpr824dkRfXLQ/ypL2b9sC9hBILGZWHfpJC MvDjA800T6JUBzwcWiYv91zBUI8/Od32frjHitBNBkJp6jBcKErtAhVh1/S5MiRnRjlV 6qEAOn2nhiNp6yLaMhfSEeAliE9o+ZXTzLvgrRrvj6DHUXdS4nUuxqEHZ8kuVfXPad4D Zzc1pUpWk/oR91bVmFNL1PPIvREloN+B7QGP19hC7ef1uUqDujYWETz5Dk7P6XqLDvP7 0RvFWFZ68R13h6UnK8JpvBoeXahIb7pA+CDkSxgH1MZcRly9iWkNPDbcnMTBZF8fd4yL aw7w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=ZDHFA90z7UuaWpfw84+jGthrSDkvxGJhthls85QXW70=; b=JhdEgNRTUwKt73IJstZf5kyDz0NLKALt5lRjKpwy//eU5awlW3phFNfV4UM589nKL0 fJ2zAdKjKiROEHe9WyjpsM5Duc5wVuNBjWuQqu1etKUY3BCclRRKnXOB1wN+IXVqVsgg MP8I+CdFu9HYM28/HJNYBcT0GYw/S8baZHyzFg7gV6LsNvjimeeX3ccbTfcKaWylhto2 QLdg/X5kVDiSD5THoMkJmXmOzLy32fEigTPAqI8MKxkx7J44YUzuQjZNzXd2hhEYbr48 l3hne5cfSMvByqf0ardk7FovmfzeZ3NHectOnw+ceA0pS6KVrpBsyhJheuprfxebiP4r OtVQ== X-Gm-Message-State: AGi0PubtrCflXE4PB2Xnp1R52TN5fT/oHwtwFUcN1eKqE9wIKmWdCnci pge4GvfW9wHTgLjzpR5SGeB0pwE3Bf2rYzloe48= X-Google-Smtp-Source: APiQypKcDo5m2jDu177dV+C2h/9JpWnYvowoN/Do7P5W+bQfrqRgBCEBuNDlAmn0dWCgEBP6ZkKDYgbqMnn+3H897Ww= X-Received: by 2002:a05:600c:21d3:: with SMTP id x19mr21976652wmj.60.1587928576967; Sun, 26 Apr 2020 12:16:16 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Anish Date: Sun, 26 Apr 2020 12:16:05 -0700 Message-ID: Subject: Re: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 To: Christian Jeannot Cc: "freebsd-virtualization@freebsd.org" X-Rspamd-Queue-Id: 499Hh25zDnz3MQh X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=AIgh20k6; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of akgupt3@gmail.com designates 2a00:1450:4864:20::32e as permitted sender) smtp.mailfrom=akgupt3@gmail.com X-Spamd-Result: default: False [-3.00 / 15.00]; ARC_NA(0.00)[]; TO_DN_EQ_ADDR_SOME(0.00)[]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[multipart/related,multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; IP_SCORE_FREEMAIL(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[e.2.3.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.5.4.1.0.0.a.2.list.dnswl.org : 127.0.5.0]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; IP_SCORE(0.00)[ip: (-9.12), ipnet: 2a00:1450::/32(-2.33), asn: 15169(-0.43), country: US(-0.05)]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:+,3:~,4:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0] X-Mailman-Approved-At: Mon, 27 Apr 2020 09:56:44 +0000 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 26 Apr 2020 19:16:20 -0000 [Resending without screenshot to reduce message size] Hi Christian, This looks like BIOS issue, BIOS must not set Bit4/SVMDIS in VM_CR MSR (0xC001_0114) if SVM is enabled. Bhyve checks for this bit before enabling SVM, otherwise it can cause GP faults. You can read it using the following steps: $kldload cpuctl $ cpucontrol -m 0xc0010114 /dev/cpuctlX <- Read VM_CR MSR MSR 0xc0010114: 0x00000000 0x00000008 X is any CPU core number. On my AMD/Ryzen system, bit4 is clear and I can load bhyve. -Anish On Sun, Apr 26, 2020 at 12:07 PM Anish wrote: > > Hi Christian, > > This looks like BIOS issue, BIOS must not set Bit4/SVMDIS in VM_CR MSR > (0xC001_0114) if SVM is enabled. Bhyve checks for this bit before > enabling SVM. You can read it using the following steps: > $kldload cpuctl > > > $ cpucontrol -m 0xc0010114 /dev/cpuctlX <- Read VM_CR MSR > MSR 0xc0010114: 0x00000000 0x00000008 > > X is any CPU core number. > > On my AMD/Ryzen system, bit4 is clear and I can load bhyve. I have > attached a screenshot from AMD SDM Vol2, which you may find useful. > > [image: Screen Shot 2020-04-26 at 12.01.14 PM.png] > > -Anish > > > > On Sun, Apr 26, 2020 at 6:27 AM Christian Jeannot > wrote: > >> I have checked MSI support page. The latest BIOS version is already >> installed. >> >> Regards >> >> --Christian >> >> Am 26.04.20 um 15:11 schrieb M. Eisenhardt: >> > I would suggest to update your bios. >> > Kind regards >> > Michael >> > >> >> Am 26.04.2020 um 14:00 schrieb >> freebsd-virtualization-request@freebsd.org: >> >> >> >> =EF=BB=BFSend freebsd-virtualization mailing list submissions to >> >> freebsd-virtualization@freebsd.org >> >> >> >> To subscribe or unsubscribe via the World Wide Web, visit >> >> https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization >> >> or, via email, send a message with subject or body 'help' to >> >> freebsd-virtualization-request@freebsd.org >> >> >> >> You can reach the person managing the list at >> >> freebsd-virtualization-owner@freebsd.org >> >> >> >> When replying, please edit your Subject line so it is more specific >> >> than "Re: Contents of freebsd-virtualization digest..." >> >> >> >> >> >> Today's Topics: >> >> >> >> 1. bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 >> >> (Christian Jeannot) >> >> 2. Re: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 >> >> (Aryeh Friedman) >> >> 3. Re: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 >> >> (Christian Jeannot) >> >> >> >> >> >> ---------------------------------------------------------------------= - >> >> >> >> Message: 1 >> >> Date: Sun, 26 Apr 2020 10:57:50 +0200 >> >> From: Christian Jeannot >> >> To: freebsd-virtualization@freebsd.org >> >> Subject: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 >> >> Message-ID: <2535c7f2-ef59-467e-779b-6c9c6db82005@os-plus.org> >> >> Content-Type: text/plain; charset=3Dutf-8; format=3Dflowed >> >> >> >> Hi Community, >> >> >> >> I am testing bhyve from FreeBSD 12.1 RELEASE. >> >> >> >> My environment: >> >> - CPU: AMD Ryze 3900X >> >> - Mainboard: MSI MEG ACE X570, Default settings, latest BIOS 7C35v18 >> >> - RAM: G.Skill RipJaws V DIMM Kit 64GB, DDR4-3200, CL16-18-18-38 >> >> - GPU: Sapphire Nitro RX 5700XT >> >> >> >> I checked the settings in the BIOS. Virtualization options are enable= d. >> >> SVM is enabled. >> >> >> >> I follow the instruction from the FreeBSD handbook ?21.7. FreeBSD as = a >> >> Host with bhyve?. >> >> >> >> When I run >> >> kldload vmm >> >> I got an output that SVM is disabled by BIOS. When I check the BIOS i= t >> >> is enabled. >> >> >> >> When I try to start the VM with the example script I got the output >> >> vm_create device not configured >> >> >> >> Did I miss something to configure? >> >> >> >> Does anyone has a Ryzen CPU and a actual MSI mainboard successfully r= un >> >> bhyve? >> >> >> >> Best regards >> >> >> >> ?Christian >> >> -- >> >> -- >> >> christian jeannot >> >> vogelmauer 17 >> >> 86152 augsburg >> >> +49 821 81552861 >> >> info@os-plus.org >> >> >> >> >> >> ------------------------------ >> >> >> >> Message: 2 >> >> Date: Sun, 26 Apr 2020 05:32:36 -0400 >> >> From: Aryeh Friedman >> >> To: Christian Jeannot >> >> Cc: "freebsd-virtualization@freebsd.org" >> >> >> >> Subject: Re: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 >> >> Message-ID: >> >> > bx7oJAEmKsXigUbhf-9wrw@mail.gmail.com> >> >> Content-Type: text/plain; charset=3D"UTF-8" >> >> >> >>> On Sun, Apr 26, 2020 at 4:57 AM Christian Jeannot >> wrote: >> >>> >> >>> Hi Community, >> >>> >> >>> I am testing bhyve from FreeBSD 12.1 RELEASE. >> >>> >> >>> My environment: >> >>> - CPU: AMD Ryze 3900X >> >>> - Mainboard: MSI MEG ACE X570, Default settings, latest BIOS 7C35v18 >> >>> - RAM: G.Skill RipJaws V DIMM Kit 64GB, DDR4-3200, CL16-18-18-38 >> >>> - GPU: Sapphire Nitro RX 5700XT >> >>> >> >>> I checked the settings in the BIOS. Virtualization options are >> enabled. >> >>> SVM is enabled. >> >>> >> >>> I follow the instruction from the FreeBSD handbook ?21.7. FreeBSD as= a >> >>> Host with bhyve?. >> >>> >> >>> When I run >> >>> kldload vmm >> >>> I got an output that SVM is disabled by BIOS. When I check the BIOS = it >> >>> is enabled. >> >>> >> >> >> >> What happens if you load it from /boot/load.conf >> >> >> >> Also you shouldn't have to turn on kvm (I do have it turned on but it >> >> should not be required). >> >> >> >> Bhyve has a upper limit of 16 vm's that it can run at once but I don'= t >> >> think this is based on core count of the processor. >> >> >> >> >> >>> When I try to start the VM with the example script I got the output >> >>> vm_create device not configured >> >>> >> >>> Did I miss something to configure? >> >>> >> >>> Does anyone has a Ryzen CPU and a actual MSI mainboard successfully >> run >> >>> bhyve? >> >>> >> >> >> >> I have two Ryzen 5 2600X/MSI machines as far I can tell looking at th= e >> >> specs (and what I remember when I was deciding to get a 3900X or 2600= X) >> >> there is no practical difference, except for core count, from the >> point of >> >> view of virtualization/bhyve. One machine is a MSI B450 Tomahawk and >> the >> >> other is MSI B450 Gaming Pro. Both machines run bhyve with out any >> >> problem (one of them is my main home office server with 3 vm's on it >> >> [windows and 2 FreeBSD]) and the other is my primary desktop machine >> and >> >> used for R&D on PetiteCloud (which is a web interface to bhyve and >> qemu). >> >> >> >> Best regards >> >>> >> >>> ?Christian >> >>> -- >> >>> -- >> >>> christian jeannot >> >>> vogelmauer 17 >> >>> 86152 augsburg >> >>> +49 821 81552861 >> >>> info@os-plus.org >> >>> _______________________________________________ >> >>> freebsd-virtualization@freebsd.org mailing list >> >>> https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization >> >>> To unsubscribe, send any mail to " >> >>> freebsd-virtualization-unsubscribe@freebsd.org" >> >>> >> >> >> >> >> >> -- >> >> Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org >> >> >> >> >> >> ------------------------------ >> >> >> >> Message: 3 >> >> Date: Sun, 26 Apr 2020 11:56:39 +0200 >> >> From: Christian Jeannot >> >> To: Aryeh Friedman >> >> Cc: freebsd-virtualization@freebsd.org >> >> Subject: Re: bhyve with AMD Ryzen 3900X and MSI MEG ACE X570 >> >> Message-ID: >> >> Content-Type: text/plain; charset=3Dutf-8; format=3Dflowed >> >> >> >> >> >> >> >>> Am 26.04.20 um 11:32 schrieb Aryeh Friedman: >> >>> >> >>> >> >>> On Sun, Apr 26, 2020 at 4:57 AM Christian Jeannot > >>> > wrote: >> >>> >> >>> Hi Community, >> >>> >> >>> I am testing bhyve from FreeBSD 12.1 RELEASE. >> >>> >> >>> My environment: >> >>> - CPU: AMD Ryze 3900X >> >>> - Mainboard: MSI MEG ACE X570, Default settings, latest BIOS >> 7C35v18 >> >>> - RAM: G.Skill RipJaws V DIMM Kit 64GB, DDR4-3200, CL16-18-18-38 >> >>> - GPU: Sapphire Nitro RX 5700XT >> >>> >> >>> I checked the settings in the BIOS. Virtualization options are >> enabled. >> >>> SVM is enabled. >> >>> >> >>> I follow the instruction from the FreeBSD handbook ?21.7. FreeBS= D >> as a >> >>> Host with bhyve?. >> >>> >> >>> When I run >> >>> ? ? ?kldload vmm >> >>> I got an output that SVM is disabled by BIOS. When I check the >> BIOS it >> >>> is enabled. >> >>> >> >>> >> >>> What happens if you load it from /boot/load.conf >> >> >> >> When I add >> >> vmm_load=3D"YES" >> >> in /boot/loader.conf I can see the following with dmesg after a reboo= t >> >> >> >> SVM: disabled by BIOS. >> >> module_register_init: MOD_LOAD (vmm, 0xffffffff8264dd20, 0) error 6 >> >> >> >>> >> >>> Also you shouldn't have to turn on kvm (I do have it turned on but i= t >> >>> should not be required). >> >>> >> >>> Bhyve has a upper limit of 16 vm's that it can run at once but I don= 't >> >>> think this is based on core count of the processor. >> >>> >> >>> >> >>> When I try to start the VM with the example script I got the >> output >> >>> ? ? ?vm_create device not configured >> >>> >> >>> Did I miss something to configure? >> >>> >> >>> Does anyone has a Ryzen CPU and a actual MSI mainboard >> successfully run >> >>> bhyve? >> >>> >> >>> >> >>> I have two Ryzen 5 2600X/MSI machines as far I can tell looking at t= he >> >>> specs (and what I remember when I was deciding to get a 3900X or >> 2600X) >> >>> there is no practical difference, except for core count, from the >> point >> >>> of view of virtualization/bhyve.? One machine is a MSI B450 Tomahawk >> and >> >>> the other is MSI B450 Gaming Pro.?? Both machines run bhyve with out >> any >> >>> problem (one of them is my main home office server with 3 vm's on it >> >>> [windows and 2 FreeBSD]) and the other is my primary desktop machine >> and >> >>> used for R&D on PetiteCloud (which is a web interface to bhyve and >> qemu). >> >> >> >> Thank you. Good to know that bhye is working with AMD CPUs, Mainboard= s >> >> and chipsets. >> >> >> >> --Christian >> >> >> >> -- >> >> -- >> >> christian jeannot >> >> vogelmauer 17 >> >> 86152 augsburg >> >> +49 821 81552861 >> >> info@os-plus.org >> >> >> >> >> >> ------------------------------ >> >> >> >> Subject: Digest Footer >> >> >> >> _______________________________________________ >> >> freebsd-virtualization@freebsd.org mailing list >> >> https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization >> >> To unsubscribe, send any mail to " >> freebsd-virtualization-unsubscribe@freebsd.org" >> >> >> >> >> >> ------------------------------ >> >> >> >> End of freebsd-virtualization Digest, Vol 490, Issue 5 >> >> ****************************************************** >> > >> > _______________________________________________ >> > freebsd-virtualization@freebsd.org mailing list >> > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization >> > To unsubscribe, send any mail to " >> freebsd-virtualization-unsubscribe@freebsd.org" >> > >> >> -- >> -- >> christian jeannot >> vogelmauer 17 >> 86152 augsburg >> +49 821 81552861 >> info@os-plus.org >> _______________________________________________ >> freebsd-virtualization@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization >> To unsubscribe, send any mail to " >> freebsd-virtualization-unsubscribe@freebsd.org" >> > From owner-freebsd-virtualization@freebsd.org Mon Apr 27 11:47:51 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 1F0CC2B4F63 for ; Mon, 27 Apr 2020 11:47:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 499jh675LBz3PXv for ; Mon, 27 Apr 2020 11:47:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id F16312B4F60; Mon, 27 Apr 2020 11:47:50 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id F11AF2B4F5F for ; Mon, 27 Apr 2020 11:47:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 499jh66B51z3PXs for ; Mon, 27 Apr 2020 11:47:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id CFC0A9D0F for ; Mon, 27 Apr 2020 11:47:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 03RBloQP093739 for ; Mon, 27 Apr 2020 11:47:50 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 03RBlorv093738 for virtualization@FreeBSD.org; Mon, 27 Apr 2020 11:47:50 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 236989] AWS EC2 lockups "Missing interrupt" Date: Mon, 27 Apr 2020 11:47:50 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: cao@bus.net X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Apr 2020 11:47:51 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D236989 --- Comment #18 from Charles O'Donnell --- Hi Colin, patch applied. It may be as long as two weeks before I can report results. With regards to running these queries: vmstat -z | grep mbuf_jumbo; sysctl -a | grep mjum_alloc_fail Let me know if this should be run periodically, or only when the machine is experiencing the issue. Thank you. Best. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Mon Apr 27 20:08:26 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 3E9412C4622 for ; Mon, 27 Apr 2020 20:08:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 499wnk0yChz4YCd for ; Mon, 27 Apr 2020 20:08:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 20B612C4621; Mon, 27 Apr 2020 20:08:26 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 207E22C4620 for ; Mon, 27 Apr 2020 20:08:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 499wnk04gSz4YCc for ; Mon, 27 Apr 2020 20:08:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id F24E1182CC for ; Mon, 27 Apr 2020 20:08:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 03RK8PZG036922 for ; Mon, 27 Apr 2020 20:08:25 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 03RK8P41036921 for virtualization@FreeBSD.org; Mon, 27 Apr 2020 20:08:25 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 236989] AWS EC2 lockups "Missing interrupt" Date: Mon, 27 Apr 2020 20:08:25 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: cperciva@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Apr 2020 20:08:26 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D236989 --- Comment #19 from Colin Percival --- Hi Charles, Can you run those periodically (maybe every hour)? What I'm expecting is t= hat the sysctls will stay at zero, while the 9k mbuf "FAIL" count (second last value) will stay at zero or perhaps increase slowly, then jump up rapidly w= hen the system would have gotten stuck. If the patch works as expected, the system *won't* get stuck at that point.= ;-) Colin Percival --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Tue Apr 28 14:30:36 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id BD4412BAB1F for ; Tue, 28 Apr 2020 14:30:36 +0000 (UTC) (envelope-from infoomatic@gmx.at) Received: from mout.gmx.net (mout.gmx.net [212.227.17.21]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "mout.gmx.net", Issuer "TeleSec ServerPass Class 2 CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49BPFR2107z3HyM for ; Tue, 28 Apr 2020 14:30:34 +0000 (UTC) (envelope-from infoomatic@gmx.at) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=gmx.net; s=badeba3b8450; t=1588084233; bh=zzhL+jjDVU+ZFJJeNjbRz9dKPXwASHI1XIhyMHlV4Tk=; h=X-UI-Sender-Class:To:From:Subject:Date; b=LhKofFES75PqserL/wxYrJlfZbQYJXKzpnpvnXWWYngrK0BnacC5TkOlXlChmhrQI lvj5c4B5Efh24onue/8otaYfcYamEkG2yLygr+F5JmZPIFSXIUW3dlGFvejhx2MQAi uNovdsrsmARP/BNUipmINlIVyttWbcsTB8wy2pNE= X-UI-Sender-Class: 01bb95c1-4bf8-414a-932a-4f6e2808ef9c Received: from [10.0.1.209] ([46.57.109.189]) by mail.gmx.com (mrgmx105 [212.227.17.168]) with ESMTPSA (Nemesis) id 1Ma24y-1jhkcv0O4S-00Vz3r for ; Tue, 28 Apr 2020 16:30:33 +0200 To: freebsd-virtualization@freebsd.org From: infoomatic Subject: bhyve pci passthrough Message-ID: Date: Tue, 28 Apr 2020 16:30:32 +0200 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:68.0) Gecko/20100101 Thunderbird/68.7.0 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Content-Language: en-US X-Provags-ID: V03:K1:DYIaJIQrA3xrxEFZ4bNTwzswMUTi0HUCf8FfvZnlVRN+HHoAWP1 jrH05KTp22GCv7NGJijAg9KM6YFmn0v2N6BDPMaxCNMc//lhTt1oY2KbElZcND2/RU0+V6P EIkph88zl9TU0H+SlHHtUo6zj6h+M77l6XJdXdpW4YrMRUAXzLtMYiQColplzg/JASNfnvQ x4p7k3ynkcw8QqST4OS7A== X-Spam-Flag: NO X-UI-Out-Filterresults: notjunk:1;V03:K0:rPywGa9gM34=:GisVzKvYF1Q2gMgpfiuNES XREvx7MSqosZuOcU8+BqTHv3LbUk3tBxOFsIyf0sxpTaeZZ7rqfkXp/HO0WjEXaFH6P0ToMZY HJUMBqoQmF2TendT0J19BAvMnqvucgbVhY9zu0/Bu+JVgoUjgG9GZXeVIo/5S5oJvbvciZlgV PU8OSEKAtDYLLS38EWkpi3k5FhRftb3xpek6YnNhZboapB12OyDO3ISPn0cBmsZi+clE6n4/G 1XThkTktKtuY/IoakiKCHQ0HTp2dafeVz9hp0RRVqrr9zVNbM0jzUxd/1nxg+y4xPVhsi3hlp NYBx/kzit9GnDZEFJCA+lzD1PlqlzjB69QpcHlICt8+SjOxs9E5sxlPPOdtxGMEZOC8avqMwH v6NqH26Vs3dGmiLDIxuAHqk/ie8AhdRPocFpZkQqp/fTshgacPVzBzPlVdzhY0BWw6eZBi3jd WiMoj6Hwe3VqdC4KsS7Ffb3qPOrTztcf/wB/cagGiO0FvGh6fV1j3iGk0NlTK518SlFxU+vuu l33/I+HSEcc6/6brZ1sX29YVohLtjwBWULqjGvPTnL2JgEFZ8zspa+kjTxFsE6NgHcVXWkwCt 8Zs1i37uVfeKr7ixEKOA2rXF0c1Cos8MeRL1K6kE2O8AKm+JEUjQ2q5DoBv99SPWWEACmW2gn NKg6iuwaBRsPwCiXfFvW+MH/71OLjFtHK6isMEkBweMQVbIXUF3hklDWkdptBHWM4tOHB5BpG 2U29WixgSA1tSYnu993EwZarg9mI4LEsEWVtmmwxgBEmc/OsB7pjR33iplgdUjvSo514DotXQ eSKpD5HXVSUEp8rIDjdYUmjAbQRFZm11rOg86vnGD3RUuvz1f3U8JXfkvqNkuM7HnEnfyAe54 8uloa83msuCn3feCbTjUca0j+CP9aB4IqU2f0u5LGCMFMAQHHqGDHRLJdbBZ1AIK2Jc9e3anW smTnPQTBWN/EshZnl3FwVVpUcpcB1AAkcI5be1b4JVAL96mqLQQ7Rc/GHxclat6XyhiCYm7SK unQSjE96FodW9C3uQitcT8yaxQ0RY+/rH6rQsk6Oc7Z3ZdUlqTeB19bJBAu7F7LxILa8NrrCk SHMqM3YmOCglgIXWgvrGPXZthWciXgz7nfexhjH62ryI1pnkmbnRr5w9ahqQST/twU2OQKqo2 Flxlf7GAk09B3oNC7nDK07ZxOuwEsq1WZGO5c2amqtXOh63E1eT/suo6MkXc0r9WfLYuy3lBk dfitjQB5ZtqjGERGH X-Rspamd-Queue-Id: 49BPFR2107z3HyM X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmx.net header.s=badeba3b8450 header.b=LhKofFES; dmarc=none; spf=pass (mx1.freebsd.org: domain of infoomatic@gmx.at designates 212.227.17.21 as permitted sender) smtp.mailfrom=infoomatic@gmx.at X-Spamd-Result: default: False [-2.60 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:212.227.17.0/27]; FREEMAIL_FROM(0.00)[gmx.at]; TO_DN_NONE(0.00)[]; DKIM_TRACE(0.00)[gmx.net:+]; RECEIVED_SPAMHAUS_PBL(0.00)[189.109.57.46.khpj7ygk5idzvmvt5x4ziurxhy.zen.dq.spamhaus.net : 127.0.0.11]; MIME_TRACE(0.00)[0:+]; IP_SCORE(0.00)[ip: (-6.72), ipnet: 212.227.0.0/16(-1.22), asn: 8560(2.05), country: DE(-0.02)]; RCVD_IN_DNSWL_LOW(-0.10)[21.17.227.212.list.dnswl.org : 127.0.3.1]; ASN(0.00)[asn:8560, ipnet:212.227.0.0/16, country:DE]; MID_RHS_MATCH_FROM(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[gmx.net:s=badeba3b8450]; FROM_HAS_DN(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmx.at]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; DMARC_NA(0.00)[gmx.at]; IP_SCORE_FREEMAIL(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Apr 2020 14:30:36 -0000 Hi list, I tried to passthrough my wifi card, listing as: ppt0@pci0:5:0:0: class=3D0x028000 card=3D0x00848086 chip=3D0x27238086 rev= =3D0x1a hdr=3D0x00 vendor =3D 'Intel Corporation' device =3D 'Wi-Fi 6 AX200' class =3D network However, in Linux I get the dmesg from below [1] I am running 12.1 on a ryzen 3700x. Is there anything I can do to make it = work in my Linux VM? Regards, Robert [1] [ 1265.443991] Intel(R) Wireless WiFi driver for Linux [ 1265.443991] Copyright(c) 2003- 2015 Intel Corporation [ 1265.448801] iwlwifi 0000:00:06.0: Direct firmware load for iwlwifi-cc-a= 0-50.ucode failed with error -2 [ 1265.448816] iwlwifi 0000:00:06.0: Direct firmware load for iwlwifi-cc-a= 0-49.ucode failed with error -2 [ 1265.449130] iwlwifi 0000:00:06.0: TLV_FW_FSEQ_VERSION: FSEQ Version: 43= .2.23.17 [ 1265.449133] iwlwifi 0000:00:06.0: Found debug destination: EXTERNAL_DRA= M [ 1265.449134] iwlwifi 0000:00:06.0: Found debug configuration: 0 [ 1265.449364] iwlwifi 0000:00:06.0: loaded firmware version 48.4fa0041f.0= op_mode iwlmvm [ 1265.455105] iwlwifi 0000:00:06.0: Detected Intel(R) Wi-Fi 6 AX200 160MH= z, REV=3D0x340 [ 1265.467020] iwlwifi 0000:00:06.0: Applying debug destination EXTERNAL_D= RAM [ 1265.467316] iwlwifi 0000:00:06.0: Allocated 0x00400000 bytes for firmwa= re monitor. [ 1266.483657] iwlwifi 0000:00:06.0: Collecting data: trigger 15 fired. [ 1266.483788] iwlwifi 0000:00:06.0: Start IWL Error Log Dump: [ 1266.483791] iwlwifi 0000:00:06.0: Status: 0x00000000, count: 6 [ 1266.483793] iwlwifi 0000:00:06.0: Loaded firmware version: 48.4fa0041f.= 0 [ 1266.483794] iwlwifi 0000:00:06.0: 0x00000084 | NMI_INTERRUPT_UNKNOWN [ 1266.483795] iwlwifi 0000:00:06.0: 0x002022F0 | trm_hw_status0 [ 1266.483796] iwlwifi 0000:00:06.0: 0x00000000 | trm_hw_status1 [ 1266.483797] iwlwifi 0000:00:06.0: 0x004F8E3C | branchlink2 [ 1266.483798] iwlwifi 0000:00:06.0: 0x004E4FF4 | interruptlink1 [ 1266.483799] iwlwifi 0000:00:06.0: 0x004E4FF4 | interruptlink2 [ 1266.483800] iwlwifi 0000:00:06.0: 0x0001B1F2 | data1 [ 1266.483801] iwlwifi 0000:00:06.0: 0xFF000000 | data2 [ 1266.483802] iwlwifi 0000:00:06.0: 0xE0000008 | data3 [ 1266.483803] iwlwifi 0000:00:06.0: 0x00000000 | beacon time [ 1266.483804] iwlwifi 0000:00:06.0: 0x000F1E53 | tsf low [ 1266.483805] iwlwifi 0000:00:06.0: 0x00000000 | tsf hi [ 1266.483806] iwlwifi 0000:00:06.0: 0x00000000 | time gp1 [ 1266.483807] iwlwifi 0000:00:06.0: 0x000F7F32 | time gp2 [ 1266.483808] iwlwifi 0000:00:06.0: 0x00000001 | uCode revision type [ 1266.483809] iwlwifi 0000:00:06.0: 0x00000030 | uCode version major [ 1266.483810] iwlwifi 0000:00:06.0: 0x4FA0041F | uCode version minor [ 1266.483811] iwlwifi 0000:00:06.0: 0x00000340 | hw version [ 1266.483812] iwlwifi 0000:00:06.0: 0x18C89000 | board version [ 1266.483813] iwlwifi 0000:00:06.0: 0x8005F502 | hcmd [ 1266.483814] iwlwifi 0000:00:06.0: 0x00020000 | isr0 [ 1266.483815] iwlwifi 0000:00:06.0: 0x00000000 | isr1 [ 1266.483816] iwlwifi 0000:00:06.0: 0x00F00002 | isr2 [ 1266.483817] iwlwifi 0000:00:06.0: 0x00C0000C | isr3 [ 1266.483817] iwlwifi 0000:00:06.0: 0x00000000 | isr4 [ 1266.483818] iwlwifi 0000:00:06.0: 0x00000000 | last cmd Id [ 1266.483819] iwlwifi 0000:00:06.0: 0x0001B1F2 | wait_event [ 1266.483820] iwlwifi 0000:00:06.0: 0x00000000 | l2p_control [ 1266.483821] iwlwifi 0000:00:06.0: 0x00000020 | l2p_duration [ 1266.483822] iwlwifi 0000:00:06.0: 0x00000000 | l2p_mhvalid [ 1266.483823] iwlwifi 0000:00:06.0: 0x00000000 | l2p_addr_match [ 1266.483824] iwlwifi 0000:00:06.0: 0x00000009 | lmpm_pmg_sel [ 1266.483825] iwlwifi 0000:00:06.0: 0x00000000 | timestamp [ 1266.483826] iwlwifi 0000:00:06.0: 0x00AC0000 | flow_handler [ 1266.483872] iwlwifi 0000:00:06.0: Start IWL Error Log Dump: [ 1266.483873] iwlwifi 0000:00:06.0: Status: 0x00000000, count: 7 [ 1266.483874] iwlwifi 0000:00:06.0: 0x20000066 | NMI_INTERRUPT_HOST [ 1266.483875] iwlwifi 0000:00:06.0: 0x00000000 | umac branchlink1 [ 1266.483877] iwlwifi 0000:00:06.0: 0xC008CC3C | umac branchlink2 [ 1266.483878] iwlwifi 0000:00:06.0: 0x8048D0E6 | umac interruptlink1 [ 1266.483879] iwlwifi 0000:00:06.0: 0x8048D0E6 | umac interruptlink2 [ 1266.483880] iwlwifi 0000:00:06.0: 0x01000000 | umac data1 [ 1266.483881] iwlwifi 0000:00:06.0: 0x8048D0E6 | umac data2 [ 1266.483882] iwlwifi 0000:00:06.0: 0x00000000 | umac data3 [ 1266.483883] iwlwifi 0000:00:06.0: 0x00000030 | umac major [ 1266.483885] iwlwifi 0000:00:06.0: 0x4FA0041F | umac minor [ 1266.483886] iwlwifi 0000:00:06.0: 0x000F7F2B | frame pointer [ 1266.483887] iwlwifi 0000:00:06.0: 0xC0886284 | stack pointer [ 1266.483888] iwlwifi 0000:00:06.0: 0x0000FFFF | last host cmd [ 1266.483889] iwlwifi 0000:00:06.0: 0x00000000 | isr status reg [ 1266.483895] iwlwifi 0000:00:06.0: Fseq Registers: [ 1266.483899] iwlwifi 0000:00:06.0: 0xE0000101 | FSEQ_ERROR_CODE [ 1266.483904] iwlwifi 0000:00:06.0: 0x00290006 | FSEQ_TOP_INIT_VERSION [ 1266.483908] iwlwifi 0000:00:06.0: 0x80050008 | FSEQ_CNVIO_INIT_VERSION [ 1266.483912] iwlwifi 0000:00:06.0: 0x0000A503 | FSEQ_OTP_VERSION [ 1266.483916] iwlwifi 0000:00:06.0: 0x80000003 | FSEQ_TOP_CONTENT_VERSION [ 1266.483920] iwlwifi 0000:00:06.0: 0x4552414E | FSEQ_ALIVE_TOKEN [ 1266.483924] iwlwifi 0000:00:06.0: 0x00100530 | FSEQ_CNVI_ID [ 1266.483927] iwlwifi 0000:00:06.0: 0x00000532 | FSEQ_CNVR_ID [ 1266.483931] iwlwifi 0000:00:06.0: 0x00100530 | CNVI_AUX_MISC_CHIP [ 1266.483937] iwlwifi 0000:00:06.0: 0x00000532 | CNVR_AUX_MISC_CHIP [ 1266.483944] iwlwifi 0000:00:06.0: 0x05B0905B | CNVR_SCU_SD_REGS_SD_REG_= DIG_DCDC_VTRIM [ 1266.483950] iwlwifi 0000:00:06.0: 0x0000025B | CNVR_SCU_SD_REGS_SD_REG_= ACTIVE_VDIG_MIRROR [ 1266.483974] iwlwifi 0000:00:06.0: SecBoot CPU1 Status: 0x5fe2, CPU2 Sta= tus: 0x3 [ 1266.483975] iwlwifi 0000:00:06.0: Failed to start RT ucode: -110 [ 1266.483981] iwlwifi 0000:00:06.0: Firmware not running - cannot dump er= ror [ 1266.497137] iwlwifi 0000:00:06.0: Failed to run INIT ucode: -110 From owner-freebsd-virtualization@freebsd.org Thu Apr 30 02:12:51 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C5F672CA027 for ; Thu, 30 Apr 2020 02:12:51 +0000 (UTC) (envelope-from dmarquess@gmail.com) Received: from mail-ej1-x62e.google.com (mail-ej1-x62e.google.com [IPv6:2a00:1450:4864:20::62e]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49CJnG5wZKz46vb for ; Thu, 30 Apr 2020 02:12:50 +0000 (UTC) (envelope-from dmarquess@gmail.com) Received: by mail-ej1-x62e.google.com with SMTP id s9so3355648eju.1 for ; Wed, 29 Apr 2020 19:12:50 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=innh3kGiXOzabZbpiDWYxJyfbqEVUN3lYSFNN8RhnLU=; b=rBEPO2Ugu6qWwcp/J4wL5VKSp302bl+G9vRU3Cy768GcKHjcznmAYxupefEoMLNjk9 Q4DHReVa94RDuFJG4n7LrXIEb02cHLkIMtpP5r9tTlFQylZdpBg43Yt2crP6Qo+S/Btq 4DxD93ukLVbjZmVsLmzVuVSk2nOE4SwT2klyc5VothzWFspX9kTIdmaEAQUUwdjtr0bF ENsP+DhROjNMUUAOaVv4psH/A+OV5X9x8sVx/PZjaTW/d+M8Mt2+HDbiQZ7uBcOZR/Xu 1jd1Xhpj7G5VGqrBvZnRO981DGd6pFCqnlgOMBjtsjHmt2rs7ohFDHWB8HjhUG6bTN6i s1ZQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=innh3kGiXOzabZbpiDWYxJyfbqEVUN3lYSFNN8RhnLU=; b=kQXqtb/yVaEEBk2HN2NAPzirTYNlwg4TnJK515wSbp62DlmJuPtv9rwjgf64Fvqw20 /5hfexVCpcNLiEphBy+SUsiByAYFAzmjiWQDgJ1ELjioW3hhBpeBnzar6+8ww8KortY0 l0Rjkh7JdZqeuk/7/5Vgi/SUEOjhTxx4nvde79L+C7wkzGRAfimh9eCg81eB8luvVYfc 3cOhpT0ZPD2NUPKk8k9nH5IoLMavkMScrdwG0m9YvRCfNGeRBFiWt0mtmNvQnZneUcWC bB9qKHR/+vXK9JnqmkZMiJ3J+N9dbvDOFDTuhp28gJehKi62B6dMsi2Fx3iCo7AjUkwD AyJg== X-Gm-Message-State: AGi0Pub4eWZlfzhQ9A15QQwZ7EryvE//0ao3MZ1WCp3fqEOzWSVfHaVI uF1AHVUz7djTNwTfVjFxD7JDvx2f7LvhyLg0Da7GUS3ndzQ= X-Google-Smtp-Source: APiQypI4Z6WCxBkL8DctVV7a5WvuE7rKn1h1sWsMS6M4TM4S8kUT+mRrQ5qN+3kZnCVS9ePwPKv+Yc49fcEp34KQPWU= X-Received: by 2002:a17:906:4dc8:: with SMTP id f8mr629112ejw.23.1588212768741; Wed, 29 Apr 2020 19:12:48 -0700 (PDT) MIME-Version: 1.0 From: Dustin Marquess Date: Wed, 29 Apr 2020 21:12:37 -0500 Message-ID: Subject: bhyve + AMD + PCI passthru To: FreeBSD virtualization Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 49CJnG5wZKz46vb X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=rBEPO2Ug; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of dmarquess@gmail.com designates 2a00:1450:4864:20::62e as permitted sender) smtp.mailfrom=dmarquess@gmail.com X-Spamd-Result: default: False [-3.00 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; IP_SCORE_FREEMAIL(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; IP_SCORE(0.00)[ipnet: 2a00:1450::/32(-2.32), asn: 15169(-0.43), country: US(-0.05)]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[e.2.6.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.5.4.1.0.0.a.2.list.dnswl.org : 127.0.5.0]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 Apr 2020 02:12:51 -0000 I have this weird issue. I have a PC Engines box with a AMD SoC in it. I'm trying to pass through the USB 3.0 controller to a Windows VM. I added: hw.vmm.amdvi.enable="1" pptdevs="0/16/0" to /boot/loader.conf, rebooted, installed Windows, etc. Everything works great until I add: -s 5,passthru,0/16/0 to my bhyve command line. As soon as I add that (and don't change anything else), TitanoCore suddenly can't boot from the virtual HD anymore: Boot Failed. EFI Hard Drive .PXE-E18: Server response timeout. Boot Failed. EFI Network UEFI Interactive Shell v2.1 EDK II UEFI v2.40 (BHYVE, 0x00010000) Mapping table BLK0: Alias(s): PciRoot(0x0)/Pci(0x3,0x0)/Sata(0x0,0x0,0x0) Press ESC in 1 seconds to skip startup.nsh or any other key to continue. Shell> I take the passthru back out and Windows works fine. Does this make sense? My full command line is: bhyve -A -H -P -w -S -u -c sockets=1,cores=3,threads=1 -m 3G \ -s 0,amd_hostbridge \ -s 3,nvme,/dev/ada0 \ -s 5,passthru,0/16/0 \ -s 10,virtio-net,tap0,mac=4a:ab:0f:25:4c:b7 \ -s 20,virtio-rnd \ -s 31,lpc \ -l com1,/dev/nmdm0A -l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd win2019 Changing nvme to ahci-hd doesn't help. Only difference between the two is that "Boot Failed. EFI Hard Drive" turns into "Boot Failed. EFI Misc Device". This is really strange! Thanks, -Dustin From owner-freebsd-virtualization@freebsd.org Thu Apr 30 14:07:35 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id A4DB32BE5D2 for ; Thu, 30 Apr 2020 14:07:35 +0000 (UTC) (envelope-from crowston@protonmail.com) Received: from mail2.protonmail.ch (mail2.protonmail.ch [185.70.40.22]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "protonmail.com", Issuer "SwissSign Server Gold CA 2014 - G22" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49Ccdy2qlDz4qlj for ; Thu, 30 Apr 2020 14:07:34 +0000 (UTC) (envelope-from crowston@protonmail.com) Date: Thu, 30 Apr 2020 14:07:19 +0000 To: Dustin Marquess , FreeBSD virtualization From: Robert Crowston Reply-To: Robert Crowston Subject: Re: bhyve + AMD + PCI passthru Message-ID: <23wobPv5B3VoX-_k163WzGtqC1dBZx3THqsGjkeu3yYcEI4OlHzfW4IKWaqRc-s42yn9joG6MFS-Gok_6w0UhqYIEZEBpnGwbbl6FEII58E=@protonmail.com> In-Reply-To: References: MIME-Version: 1.0 X-Spam-Status: No, score=-1.2 required=7.0 tests=ALL_TRUSTED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,FREEMAIL_FROM,HTML_MESSAGE shortcircuit=no autolearn=disabled version=3.4.4 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on mail.protonmail.ch X-Rspamd-Queue-Id: 49Ccdy2qlDz4qlj X-Spamd-Bar: -- X-Spamd-Result: default: False [-3.00 / 15.00]; HAS_REPLYTO(0.00)[crowston@protonmail.com]; R_SPF_ALLOW(-0.20)[+ip4:185.70.40.0/24]; FREEMAIL_FROM(0.00)[protonmail.com]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[protonmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[protonmail.com,quarantine]; RCPT_COUNT_TWO(0.00)[2]; MIME_BASE64_TEXT(0.10)[]; FREEMAIL_TO(0.00)[gmail.com]; RCVD_COUNT_ZERO(0.00)[0]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; IP_SCORE(0.00)[ip: (-9.74), ipnet: 185.70.40.0/24(-4.89), asn: 62371(-3.91), country: CH(0.04)]; RCVD_IN_DNSWL_LOW(-0.10)[22.40.70.185.list.dnswl.org : 127.0.5.1]; ASN(0.00)[asn:62371, ipnet:185.70.40.0/24, country:CH]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[protonmail.com]; R_DKIM_ALLOW(-0.20)[protonmail.com:s=protonmail]; REPLYTO_EQ_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; FREEMAIL_REPLYTO(0.00)[protonmail.com]; HAS_PHPMAILER_SIG(0.00)[]; IP_SCORE_FREEMAIL(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[] Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: base64 X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 Apr 2020 14:07:35 -0000 Rmlyc3QsIGRvIHRoZXNlIEphZ3VhciBwcm9jZXNzb3JzIHN1cHBvcnQgZGV2aWNlIHBhc3N0aHJv dWdoPwoKSXMgdGhlcmUgYW55dGhpbmcgaW50ZXJlc3RpbmcgaW4gZG1lc2c/IFdoYXQgZG9lcyBw Y2ljb25mIHNob3c/IE1heWJlIGJoeXZlIGNsYWltaW5nIHRoZSBVU0IgY29udHJvbGxlciBpcyBp bnRlcmZlcmluZyB3aXRoIFNBVEEgc29tZWhvdy4gT24gbXkgcGNlbmdpbmVzIGJvYXJkIHRoZSB0 d28gZGV2aWNlcyBhcmUgbG9naWNhbCBuZWlnaGJvdXJzLCBhbmQgSSBndWVzcyB5b3VyIHNjZW5h cmlvIGhhcyBuZXZlciBiZWVuIHRlc3RlZC4KCkNhbiB5b3Ugc2VlIGFkYTDigJlzIEZBVCBmaWxl IHN5c3RlbSBpbiB0aGUgdmlydHVhbCBVRUZJIGd1aT8gSWYgeW91IGNhbiwgd2hhdCBoYXBwZW5z IGlmIHlvdSBleGVjdXRlIHRoZSBib290IGxvYWRlciBtYW51YWxseT8KCkkgbm9ybWFsbHkgcG9p bnQgdGhlIHZpcnR1YWwgc3RvcmFnZSBhdCBhIGJsb2NrIGZpbGUgKG9yIGEgenZvbCkgcmF0aGVy IHRoYW4gZXNzZW50aWFsbHkgcGFzcyB0aHJvdWdoIGEgcmVhbCBkZXZpY2UgbGlrZSAvZGV2L2Fk YTAuIENhbiB5b3UgdHJ5IHRoYXQ/TWF5YmUgdHJ5IGEgZ3Vlc3QgTGludXggaW5zdGFsbGF0aW9u IGZpcnN0IHVzaW5nIGEgYmxvY2sgZmlsZSBvbiB5b3VyIGJvb3QgZGlzay4gVGhlIGRpYWdub3N0 aWNzIHdpbGwgYmUgYmV0dGVyIHRoYW4gYSBXaW5kb3dzIGd1ZXN0LgoKRmluYWxseSB3aGljaCB2 ZXJzaW9uIG9mIFNlYUJJT1MgYXJlIHlvdSB1c2luZz8KCihBbHNvLCB0b28gbGF0ZSBpZiB5b3Ug YWxyZWFkeSBpbnN0YWxsZWQgV2luZG93cywgYnV0IHdoeSBub3QgdXNlIHRoZSBwYXJhdmlydHVh bGl6ZWQgdmlydHVhbCBkaXNrIGRldmljZSBpbnN0ZWFkIG9mIG52bWU/KQoKT24gVGh1LCBBcHIg MzAsIDIwMjAgYXQgMDM6MTIsIER1c3RpbiBNYXJxdWVzcyA8ZG1hcnF1ZXNzQGdtYWlsLmNvbT4g d3JvdGU6Cgo+IEkgaGF2ZSB0aGlzIHdlaXJkIGlzc3VlLiBJIGhhdmUgYSBQQyBFbmdpbmVzIGJv eCB3aXRoIGEgQU1EIFNvQyBpbiBpdC4KPgo+IEknbSB0cnlpbmcgdG8gcGFzcyB0aHJvdWdoIHRo ZSBVU0IgMy4wIGNvbnRyb2xsZXIgdG8gYSBXaW5kb3dzIFZNLiBJIGFkZGVkOgo+Cj4gaHcudm1t LmFtZHZpLmVuYWJsZT0iMSIKPiBwcHRkZXZzPSIwLzE2LzAiCj4KPiB0byAvYm9vdC9sb2FkZXIu Y29uZiwgcmVib290ZWQsIGluc3RhbGxlZCBXaW5kb3dzLCBldGMuIEV2ZXJ5dGhpbmcKPiB3b3Jr cyBncmVhdCB1bnRpbCBJIGFkZDoKPgo+IC1zIDUscGFzc3RocnUsMC8xNi8wCj4KPiB0byBteSBi aHl2ZSBjb21tYW5kIGxpbmUuIEFzIHNvb24gYXMgSSBhZGQgdGhhdCAoYW5kIGRvbid0IGNoYW5n ZQo+IGFueXRoaW5nIGVsc2UpLCBUaXRhbm9Db3JlIHN1ZGRlbmx5IGNhbid0IGJvb3QgZnJvbSB0 aGUgdmlydHVhbCBIRAo+IGFueW1vcmU6Cj4KPiBCb290IEZhaWxlZC4gRUZJIEhhcmQgRHJpdmUK PiAuUFhFLUUxODogU2VydmVyIHJlc3BvbnNlIHRpbWVvdXQuCj4gQm9vdCBGYWlsZWQuIEVGSSBO ZXR3b3JrCj4gVUVGSSBJbnRlcmFjdGl2ZSBTaGVsbCB2Mi4xCj4gRURLIElJCj4gVUVGSSB2Mi40 MCAoQkhZVkUsIDB4MDAwMTAwMDApCj4gTWFwcGluZyB0YWJsZQo+IEJMSzA6IEFsaWFzKHMpOgo+ IFBjaVJvb3QoMHgwKS9QY2koMHgzLDB4MCkvU2F0YSgweDAsMHgwLDB4MCkKPiBQcmVzcyBFU0Mg aW4gMSBzZWNvbmRzIHRvIHNraXAgc3RhcnR1cC5uc2ggb3IgYW55IG90aGVyIGtleSB0byBjb250 aW51ZS4KPiBTaGVsbD4KPgo+IEkgdGFrZSB0aGUgcGFzc3RocnUgYmFjayBvdXQgYW5kIFdpbmRv d3Mgd29ya3MgZmluZS4KPgo+IERvZXMgdGhpcyBtYWtlIHNlbnNlPwo+Cj4gTXkgZnVsbCBjb21t YW5kIGxpbmUgaXM6Cj4KPiBiaHl2ZSAtQSAtSCAtUCAtdyAtUyAtdSAtYyBzb2NrZXRzPTEsY29y ZXM9Myx0aHJlYWRzPTEgLW0gM0cgXAo+IC1zIDAsYW1kX2hvc3RicmlkZ2UgXAo+IC1zIDMsbnZt ZSwvZGV2L2FkYTAgXAo+IC1zIDUscGFzc3RocnUsMC8xNi8wIFwKPiAtcyAxMCx2aXJ0aW8tbmV0 LHRhcDAsbWFjPTRhOmFiOjBmOjI1OjRjOmI3IFwKPiAtcyAyMCx2aXJ0aW8tcm5kIFwKPiAtcyAz MSxscGMgXAo+IC1sIGNvbTEsL2Rldi9ubWRtMEEgLWwKPiBib290cm9tLC91c3IvbG9jYWwvc2hh cmUvdWVmaS1maXJtd2FyZS9CSFlWRV9VRUZJLmZkIHdpbjIwMTkKPgo+IENoYW5naW5nIG52bWUg dG8gYWhjaS1oZCBkb2Vzbid0IGhlbHAuIE9ubHkgZGlmZmVyZW5jZSBiZXR3ZWVuIHRoZQo+IHR3 byBpcyB0aGF0ICJCb290IEZhaWxlZC4gRUZJIEhhcmQgRHJpdmUiIHR1cm5zIGludG8gIkJvb3Qg RmFpbGVkLiBFRkkKPiBNaXNjIERldmljZSIuCj4KPiBUaGlzIGlzIHJlYWxseSBzdHJhbmdlIQo+ Cj4gVGhhbmtzLAo+IC1EdXN0aW4KPiBfX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fXwo+IGZyZWVic2QtdmlydHVhbGl6YXRpb25AZnJlZWJzZC5vcmcgbWFpbGlu ZyBsaXN0Cj4gaHR0cHM6Ly9saXN0cy5mcmVlYnNkLm9yZy9tYWlsbWFuL2xpc3RpbmZvL2ZyZWVi c2QtdmlydHVhbGl6YXRpb24KPiBUbyB1bnN1YnNjcmliZSwgc2VuZCBhbnkgbWFpbCB0byAiZnJl ZWJzZC12aXJ0dWFsaXphdGlvbi11bnN1YnNjcmliZUBmcmVlYnNkLm9yZyI= From owner-freebsd-virtualization@freebsd.org Thu Apr 30 14:52:59 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8E9812BFC39 for ; Thu, 30 Apr 2020 14:52:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 49CdfM3Hd5z4tlh for ; Thu, 30 Apr 2020 14:52:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 6EF682BFC35; Thu, 30 Apr 2020 14:52:59 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 6D9E72BFC33 for ; Thu, 30 Apr 2020 14:52:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49CdfM2LCJz4tlf for ; Thu, 30 Apr 2020 14:52:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4BB54209E8 for ; Thu, 30 Apr 2020 14:52:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 03UEqxR8035312 for ; Thu, 30 Apr 2020 14:52:59 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 03UEqxrX035311 for virtualization@FreeBSD.org; Thu, 30 Apr 2020 14:52:59 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 236042] Windows Server 2016 Hyper-V snapshot triggers SCSI errors Date: Thu, 30 Apr 2020 14:52:58 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: mattbju2013@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 Apr 2020 14:52:59 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D236042 meichthys changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |mattbju2013@gmail.com --- Comment #12 from meichthys --- I am also seeing this when Veeam takes a snapshot of my HyperV VM running FreeNAS. FreeNAS seems to lock up for a short amount of time and then seems= to recover after a few minutes. (da1:storvsc1:0:0:0): WRITE(10). CDB: 2a 00 2c 10 8e 88 00 00 08 00 (da1:storvsc1:0:0:0): CAM status: SCSI Status Error (da1:storvsc1:0:0:0): SCSI status: Check Condition (da1:storvsc1:0:0:0): SCSI sense: UNIT ATTENTION asc:3f,2 (Changed operating definition) (da1:storvsc1:0:0:0): Retrying command (per sense data) Hyperv-2019 FreeNAS-11.3-U1 Veeam Backup & Replication 10 (For HyperV VM replication) --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Thu Apr 30 19:06:03 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 1E6402C5E08 for ; Thu, 30 Apr 2020 19:06:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 49ClGL4X0lz3R7Y for ; Thu, 30 Apr 2020 19:06:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 991472C5E07; Thu, 30 Apr 2020 19:06:02 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 97BBA2C5E06 for ; Thu, 30 Apr 2020 19:06:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49ClGL3HWWz3R7T for ; Thu, 30 Apr 2020 19:06:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 6C2BC23A07 for ; Thu, 30 Apr 2020 19:06:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 03UJ62WD082958 for ; Thu, 30 Apr 2020 19:06:02 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 03UJ62SN082956 for virtualization@FreeBSD.org; Thu, 30 Apr 2020 19:06:02 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 236042] Windows Server 2016 Hyper-V snapshot triggers SCSI errors Date: Thu, 30 Apr 2020 19:06:01 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: decui@microsoft.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 Apr 2020 19:06:03 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D236042 --- Comment #13 from Dexuan Cui --- (In reply to Michael from comment #11) When you see the SCSI errors, can the live backup procedure succeed? Do you notice any instability issue (e.g.hang/panic)? Do you notice any data corruption issue (e.g. the back-up procedure says it succeeded, but later y= ou may find that the data is not really consistently backed up, i.e. 'fsck' may run while you think it should not)? If the backup procedure still succeeds, and you never notice any real issue, then I think it should be safe to ignore the SCSI error messages -- if we w= ant to get rid of the messages, it looks sys/dev/hyperv/utilities/hv_snapshot.= c is not an issue -- it looks we need to improve sys/dev/hyperv/storvsc/hv_storvsc_drv_freebsd.c and/or the other part of SC= SI subsystem. Linux VM on Hyper-V shows the same/similar messages when Hyper-V live backu= p is being performed (at least this was the case in June 2017): sd 2:0:0:0: [storvsc] Sense Key : Unit Attention [current] sd 2:0:0:0: [storvsc] Add. Sense: Changed operating definition sd 2:0:0:0: Warning! Received an indication that the operating parameters on this target have changed. The Linux SCSI layer does not automatically adjust these parameters. These messages in a Linux VM can be seen even if the back-up is successful,= so it looks people just ignore the messages in Linux.=20 The messages are caused as a result of the way how Hyper-V live-backup work= s: usually the VM's .vhdx file has a block size of 32MB, and during the live-backup procedure IIRC it looks a temporary .avhdx of a 2MB block size = is generated and the host returns sense key "Unit Attention" with asc 0x3f and ascq 0x2 (Changed Operating Definition); the host sends "Unit Attention" because the backing VHD block size has changed after checkpoint or backup a= nd this results in a change in the granularity of the UNMAP. Linux SCSI layer can deal with the following asc 0x3f on Unit Attention: ascq 0x3 (Inquiry Data Has Changed) ascq 0xe (Reported Luns Data Has Changed) However ascq 0x2 is ignored. The SCSI won=E2=80=99t know the UNMAP granular= ity change, it will run at probably slower UNMAP but won=E2=80=99t affect other parts. Note: I excerpted the above details from a 2017 email discussing the SCSI errors in a Linux VM on Hyper-V. My understanding is that the messages can = be safely ignored in Linux, but I'm not sure about FreeBSD, as the SCSI subsys= tem in FreeBSD may handle the sense info in a different manner.=20 I have moved on to different projects, so I am sorry I can not follow this up... I hope someone would find the info I shared here is useful, in case something has to be done in FreeBSD VM. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Sat May 2 12:09:04 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 649E62CE2B9 for ; Sat, 2 May 2020 12:09:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 49DnwJ21yxz47RP for ; Sat, 2 May 2020 12:09:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 458D72CE2B8; Sat, 2 May 2020 12:09:04 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 455242CE2B7 for ; Sat, 2 May 2020 12:09:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49DnwJ18Hfz47RN for ; Sat, 2 May 2020 12:09:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 22E7C2163B for ; Sat, 2 May 2020 12:09:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 042C94E7071832 for ; Sat, 2 May 2020 12:09:04 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 042C94IY071823 for virtualization@FreeBSD.org; Sat, 2 May 2020 12:09:04 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 246121] [bhyve][PATCH] Append Keyboard Layout specified option for using VNC. Date: Sat, 02 May 2020 12:09:04 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koinec@yahoo.co.jp X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter attachments.mimetype attachments.created Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 02 May 2020 12:09:04 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D246121 Bug ID: 246121 Summary: [bhyve][PATCH] Append Keyboard Layout specified option for using VNC. Product: Base System Version: Unspecified Hardware: amd64 OS: Any Status: New Severity: Affects Only Me Priority: --- Component: bhyve Assignee: virtualization@FreeBSD.org Reporter: koinec@yahoo.co.jp Attachment #214027 text/plain mime type: Created attachment 214027 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D214027&action= =3Dedit [bhyve][PATCH] Append Keyboard Layout specified option for using VNC. When a guest OS is loaded using UEFI and connected with VNC, if the keyboar= d on the VNC client side is other than the US keyboard, some keys input may not = be p erformed correctly. For example, if you press the '@' key on a Japanese keyboard, the number '2' will be entered on the guest OS. The cause is that the '@' key on the US keyboard is assigned to Shift + '2' keys. In addition, there is a problem that keys that do not exist on the US keybo= ard cannot be entered. (example, Zenkaku-Hankaku key in the Japanese Keyboard) In the current bhyve(13-Current & 12.1-RELEASE-p3), in the virtual PS2 keyb= oard driver, there is a conversion table that converts from the key entered from= the VNC client side to the virtual keyboard ScanCode for the Guest OS. However, since this conversion table is set for US keyboards, the above pro= blem will occur if the client side is not a US keyboard. Therefore, I created a patch that allows the conversion table to be set in = the external configuration file for each keyboard layout, and that the configuration file (=3Dkeyboard layout) can be specified by the option '-k' of the bhyve command. The following shows how to apply the patch and how to use it. Please merge it into the source tree if possible. I'm new to creating a patch for the FreeBSD source tree, and I'm not sure if it's correct to submit to Bugzilla. If it's wrong to submit it to Bugzilla, it would be very helpful if you cou= ld tell me how to submit it. A. How to apply the patch ---------------------------------- 1. cd /usr/src/usr.sbin 2. patch -u < bhyve_kbdlayout_fbsd13c.patch 3. sh bhyve_kbdlayout.shar 4. cd /usr/src/usr.sbin/bhyve 5. make 6. make install * If you use the FreeBSD 12.1-RELEASE, please replace the "fbsd13c" of the above No.2 to the "fbsd121r". B. How to specified the keyboard layout -------------------- If you use the bhyve command directly, specify the '-k layout' option for= the bhyve command. You can specify the "layout" in the file name stored in /usr/share/bhyve/kbdlayout dir. If no '-k' option is specified, the US keyboard (default) is assumed to be selected. Others, If you use the bhyve via the vm-bhyve package, specify the follow= ing lines for the Guest OS configure file. bhyve_options=3D"-k layout" C. Request for Coooperation (The remaining tasks) ---------- Currently, the keyboard layout setting file can only be created for Japan= ese keyboards. (Because, I have only the Japanese Keyboard...) If you would like to adopt this patch, I would like to ask those who use keyboards of the corresponding languages to create keyboard layout setting files oth er than English and Japanese keyboards. See the 'default' file in the /usr/share/bhyve/kbdlayout dir. for how to create it. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Sat May 2 20:32:57 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C1CBA2C28FB for ; Sat, 2 May 2020 20:32:57 +0000 (UTC) (envelope-from ryan@teck.ca) Received: from mx1.engelschall.com (mx1.engelschall.com [148.251.204.33]) by mx1.freebsd.org (Postfix) with ESMTP id 49F15h4Jyjz4drM for ; Sat, 2 May 2020 20:32:56 +0000 (UTC) (envelope-from ryan@teck.ca) Received: by mx1.engelschall.com (Postfix, from userid 21100) id 768983602A; Sat, 2 May 2020 22:22:06 +0200 (CEST) Received: from teck.ca (en1.home.engelschall.com [10.1.0.10]) by en1.engelschall.com (Postfix) with ESMTPS id DF60122D01 for ; Sat, 2 May 2020 22:18:16 +0200 (CEST) From: freebsd.org To: freebsd-virtualization@freebsd.org Subject: Quarantine notification - freebsd.org Date: 02 May 2020 20:18:47 +0000 Message-ID: <20200502201847.4836BF2466A1D1B4@teck.ca> X-Rspamd-Queue-Id: 49F15h4Jyjz4drM X-Spamd-Bar: ++++ Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of ryan@teck.ca has no SPF policy when checking 148.251.204.33) smtp.mailfrom=ryan@teck.ca X-Spamd-Result: default: False [4.91 / 15.00]; ARC_NA(0.00)[]; NEURAL_SPAM_MEDIUM(0.13)[0.129,0]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; ZERO_FONT(0.20)[2]; MIME_TRACE(0.00)[0:~]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; AUTH_NA(1.00)[]; RCPT_COUNT_ONE(0.00)[1]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_NONE(0.00)[]; MANY_INVISIBLE_PARTS(0.10)[2]; NEURAL_SPAM_LONG(0.96)[0.962,0]; DMARC_NA(0.00)[teck.ca]; MIME_HTML_ONLY(0.20)[]; R_SPF_NA(0.00)[]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; R_NO_SPACE_IN_FROM(1.00)[]; ASN(0.00)[asn:24940, ipnet:148.251.0.0/16, country:DE]; MID_RHS_MATCH_FROM(0.00)[]; IP_SCORE(-0.28)[ipnet: 148.251.0.0/16(0.11), asn: 24940(-1.51), country: DE(-0.02)]; URIBL_XBL(1.50)[managementstresscentre.co.uk] MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 02 May 2020 20:32:58 -0000