From owner-freebsd-virtualization@freebsd.org Mon Sep 14 02:48:46 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 230EE3EF964 for ; Mon, 14 Sep 2020 02:48:46 +0000 (UTC) (envelope-from pete@nomadlogic.org) Received: from mail.nomadlogic.org (mail.nomadlogic.org [174.136.98.114]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mail.nomadlogic.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BqW5S5wp8z455W; Mon, 14 Sep 2020 02:48:44 +0000 (UTC) (envelope-from pete@nomadlogic.org) Received: from [192.168.1.50] (cpe-23-243-161-111.socal.res.rr.com [23.243.161.111]) by mail.nomadlogic.org (OpenSMTPD) with ESMTPSA id 019a2ab1 (TLSv1.3:TLS_AES_256_GCM_SHA384:256:NO); Mon, 14 Sep 2020 02:48:37 +0000 (UTC) Subject: Re: Nested Virtualization Under KVM Hypervisor To: Peter Grehan Cc: FreeBSD virtualization References: <5eacd0a5-89bd-cc98-6c5a-d5490e33b100@freebsd.org> <5e62480f-14cb-5963-f753-8562aab381e3@nomadlogic.org> <5ffc62fe-96ac-a834-1682-1be2a9f50d6d@freebsd.org> From: Pete Wright Message-ID: <8ce4ea45-f6e8-7560-1e4c-dfa24e5b2289@nomadlogic.org> Date: Sun, 13 Sep 2020 19:48:32 -0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:68.0) Gecko/20100101 Thunderbird/68.12.0 MIME-Version: 1.0 In-Reply-To: <5ffc62fe-96ac-a834-1682-1be2a9f50d6d@freebsd.org> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-US X-Rspamd-Queue-Id: 4BqW5S5wp8z455W X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of pete@nomadlogic.org designates 174.136.98.114 as permitted sender) smtp.mailfrom=pete@nomadlogic.org X-Spamd-Result: default: False [-2.74 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[nomadlogic.org]; NEURAL_HAM_LONG(-1.03)[-1.034]; RECEIVED_SPAMHAUS_PBL(0.00)[23.243.161.111:received]; NEURAL_HAM_MEDIUM(-1.00)[-0.999]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-0.41)[-0.412]; RCPT_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:25795, ipnet:174.136.96.0/20, country:US]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-virtualization]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 Sep 2020 02:48:46 -0000 On 9/12/20 11:30 PM, Peter Grehan wrote: > Hi Pete, > >> Ah I see - once I realized we had a newer kernel I didn't focus too >> much on the first bug - here's the MSR's >> >> >> MSR 0x480: 0x00981000 0x11e57ed0 >> MSR 0x482: 0xfff9fffe 0x0401e172 >> MSR 0x48b: 0x000003fb 0x00000000 >> MSR 0x48c: 0x00000f01 0x04114040 > >  This looks very similar to comment 14 in the bug report >      https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=203994#c14 > >  INS/OUTS isn't marked as supported, and single-context INVEPT is > missing. As mentioned in comment 17, these are simple to work around > but other issues started to show up, indicating that other problems > are at play. > >  Given kernel 4.15 looks like it could be from Ubuntu 16-LTS, I'd > recommend moving to 18-LTS if that is possible, since that kernel > version is known to work. > Thanks Peter for this feedback!  I'll relay this info back to my hosting provider. Cheers, -pete -- Pete Wright pete@nomadlogic.org @nomadlogicLA