From owner-freebsd-virtualization@freebsd.org Sun Oct 7 10:08:16 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A7CE910BB9B3 for ; Sun, 7 Oct 2018 10:08:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 4280A7DAD7 for ; Sun, 7 Oct 2018 10:08:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 06ABA10BB9B2; Sun, 7 Oct 2018 10:08:16 +0000 (UTC) Delivered-To: virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E966110BB9B1 for ; Sun, 7 Oct 2018 10:08:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 8AEC27DAD6 for ; Sun, 7 Oct 2018 10:08:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id D867718314 for ; Sun, 7 Oct 2018 10:08:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w97A8EUO029333 for ; Sun, 7 Oct 2018 10:08:14 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w97A8EXi029332 for virtualization@FreeBSD.org; Sun, 7 Oct 2018 10:08:14 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 231117] I/O lockups inside bhyve vms Date: Sun, 07 Oct 2018 10:08:12 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.2-RELEASE X-Bugzilla-Keywords: regression X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: kkc@duckpond.dk X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 07 Oct 2018 10:08:17 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D231117 --- Comment #6 from Kristian K. Christensen --- So, after a bit of testing, regretably a fair amount of it in production: It would seem that boosting vnodes helped initially, though eventually it didn't matter. Some systems run without problems, it seems the more memory,= the more stable. I have no conclusive evidence of this though. Others seem to d= ie increasingly frequently over time. Eventually getting to the point where the system is inresponsive about 30 minutes after last forced reboot. Based on this, I have a hard time figuring out if it's related to the other issue. A= s I am unable to log in, once the condition occurs, getting any sort of debug output is tricky as well. Downgrading to 11.1 fixes the issue. I'll stay here for a bit, wait for #22= 9614 to get resolved and ported to 11.2, after which I'll give it another go. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Sun Oct 7 15:31:34 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id EFF1D10C4E5C for ; Sun, 7 Oct 2018 15:31:33 +0000 (UTC) (envelope-from ml@netfence.it) Received: from soth.netfence.it (net-2-44-121-52.cust.vodafonedsl.it [2.44.121.52]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "mailserver.netfence.it", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 6403B88AC1 for ; Sun, 7 Oct 2018 15:31:32 +0000 (UTC) (envelope-from ml@netfence.it) Received: from alamar.ventu (alamar.local.netfence.it [10.1.2.18]) (authenticated bits=0) by soth.netfence.it (8.15.2/8.15.2) with ESMTPSA id w97FVLXG074596 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NO) for ; Sun, 7 Oct 2018 17:31:27 +0200 (CEST) (envelope-from ml@netfence.it) X-Authentication-Warning: soth.netfence.it: Host alamar.local.netfence.it [10.1.2.18] claimed to be alamar.ventu From: Andrea Venturoli Subject: bhyve performance problem with SQL server To: freebsd-virtualization@freebsd.org Message-ID: Date: Sun, 7 Oct 2018 17:31:17 +0200 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:60.0) Gecko/20100101 Thunderbird/60.0.1 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 07 Oct 2018 15:31:34 -0000 Hello. I've got a FreeBSD 11.2 box running vm-bhyve with two Windows virtual machines, each with an instance of MS SQL server. Everything works fine normally, but there's a specific operation which will impose an high CPU load on the machine and last several minutes, when it's expected to get the results in a few seconds. I think I have to pass this trouble to the "programming" people, but before I do that, I'd like to double-check this is not a system problem. Some notes: _ that specific operation will put the two VMs in touch with each other, as one will contact the DBMS on the other and import data; however, that's not the only procedure which does such a thing and the others are working fine; _ during the execution of such procedure, the load on the host rises, as both VMs show high CPU usage (in Task Manager), top shows both bhyve processes in kqread (but this happens all the time), disk activity doesn't seem so high; _ the box has a Quad-Core CPU and I assigned two cores to each VM (I have hw.vmm.topology.cores_per_package=4 in /boot/loader.conf); _ both VMs use virtio-net, with both tap interfaces connected to the same "virtual switch"; _ both VMs use a zvol for their HD. Before I sentence this is an application level problem, is there some improvment I could do to the above? Any check or test I should run? bye & Thanks av. From owner-freebsd-virtualization@freebsd.org Sun Oct 7 18:46:57 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 131AF10C9567 for ; Sun, 7 Oct 2018 18:46:57 +0000 (UTC) (envelope-from allanjude@freebsd.org) Received: from mx1.scaleengine.net (mx1.scaleengine.net [209.51.186.6]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 8375F8F65F for ; Sun, 7 Oct 2018 18:46:56 +0000 (UTC) (envelope-from allanjude@freebsd.org) Received: from [10.1.1.2] (Seawolf.HML3.ScaleEngine.net [209.51.186.28]) (Authenticated sender: allanjude.freebsd@scaleengine.com) by mx1.scaleengine.net (Postfix) with ESMTPSA id DF7221B058 for ; Sun, 7 Oct 2018 18:46:55 +0000 (UTC) Subject: Re: bhyve performance problem with SQL server To: freebsd-virtualization@freebsd.org References: From: Allan Jude Openpgp: preference=signencrypt Autocrypt: addr=allanjude@freebsd.org; prefer-encrypt=mutual; keydata= xsFNBFVwZcYBEADwrZDH0xe0ZVjc9ORCc6PcBLwS/RTXA6NkvpD6ea02pZ8lPOVgteuuugFc D34LdDbiWr+479vfrKBh+Y38GL0oZ0/13j10tIlDMHSa5BU0y6ACtnhupFvVlQ57+XaJAb/q 7qkfSiuxVwQ3FY3PL3cl1RrIP5eGHLA9hu4eVbu+FOX/q/XVKz49HaeIaxzo2Q54572VzIo6 C28McX9m65UL5fXMUGJDDLCItLmehZlHsQQ+uBxvODLFpVV2lUgDR/0rDa0B9zHZX8jY8qQ7 ZdCSy7CwClXI054CkXZCaBzgxYh/CotdI8ezmaw7NLs5vWNTxaDEFXaFMQtMVhvqQBpHkfOD 7rjjOmFw00nJL4FuPE5Yut0CPyx8vLjVmNJSt/Y8WxxmhutsqJYFgYfWl/vaWkrFLur/Zcmz IklwLw35HLsCZytCN5A3rGKdRbQjD6QPXOTJu0JPrJF6t2xFkWAT7oxnSV0ELhl2g+JfMMz2 Z1PDmS3NRnyEdqEm7NoRGXJJ7bgxDbN+9SXTyOletqGNXj/bSrBvhvZ0RQrzdHAPwQUfVSU2 qBhQEi2apSZstgVNMan0GUPqCdbE2zpysg+zT7Yhvf9EUQbzPL4LpdK1llT9fZbrdMzEXvEF oSvwJFdV3sqKmZc7b+E3PuxK6GTsKqaukd/3Cj8aLHG1T1im1QARAQABzSJBbGxhbiBKdWRl IDxhbGxhbmp1ZGVAZnJlZWJzZC5vcmc+wsF/BBMBAgApBQJVcGXGAhsjBQkSzAMABwsJCAcD AgEGFQgCCQoLBBYCAwECHgECF4AACgkQGZU1PhKYC34Muw/+JOKpSfhhysWFYiRXynGRDe07 Z6pVsn7DzrPUMRNZfHu8Uujmmy3p2nx9FelIY9yjd2UKHhug+whM54MiIFs90eCRVa4XEsPR 4FFAm0DAWrrb7qhZFcE/GhHdRWpZ341WAElWf6Puj2devtRjfYbikvj5+1V1QmDbju7cEw5D mEET44pTuD2VMRJpu2yZZzkM0i+wKFuPxlhqreufA1VNkZXI/rIfkYWK+nkXd9Efw3YdCyCQ zUgTUCb88ttSqcyhik/li1CDbXBpkzDCKI6I/8fAb7jjOC9LAtrZJrdgONywcVFoyK9ZN7EN AVA+xvYCmuYhR/3zHWH1g4hAm1v1+gIsufhajhfo8/wY1SetlzPaYkSkVQLqD8T6zZyhf+AN bC7ci44UsiKGAplB3phAXrtSPUEqM86kbnHg3fSx37kWKUiYNOnx4AC2VXvEiKsOBlpyt3dw WQbOtOYM+vkfbBwDtoGOOPYAKxc4LOIt9r+J8aD+gTooi9Eo5tvphATf9WkCpl9+aaGbSixB tUpvQMRnSMqTqq4Z7DeiG6VMRQIjsXDSLJEUqcfhnLFo0Ko/RiaHd5xyAQ4DhQ9QpkyQjjNf /3f/dYG7JAtoD30txaQ5V8uHrz210/77DRRX+HJjEj6xCxWUGvQgvEZf5XXyxeePvqZ+zQyT DX61bYw6w6bOwU0EVXBlxgEQAMy7YVnCCLN4oAOBVLZ5nUbVPvpUhsdA94/0/P+uqCIh28Cz ar56OCX0X19N/nAWecxL4H32zFbIRyDB2V/MEh4p9Qvyu/j4i1r3Ex5GhOT2hnit43Ng46z5 29Es4TijrHJP4/l/rB2VOqMKBS7Cq8zk1cWqaI9XZ59imxDNjtLLPPM+zQ1yE3OAMb475QwN UgWxTMw8rkA7CEaqeIn4sqpTSD5C7kT1Bh26+rbgJDZ77D6Uv1LaCZZOaW52okW3bFbdozV8 yM2u+xz2Qs8bHz67p+s+BlygryiOyYytpkiK6Iy4N7FTolyj5EIwCuqzfk0SaRHeOKX2ZRjC qatkgoD/t13PNT38V9tw3qZVOJDS0W6WM8VSg+F+bkM9LgJ8CmKV+Hj0k3pfGfYPOZJ/v18i +SmZmL/Uw2RghnwDWGAsPCKu4uZR777iw7n9Io6Vfxndw2dcS0e9klvFYoaGS6H2F13Asygr WBzFNGFQscN4mUW+ZYBzpTOcHkdT7w8WS55BmXYLna+dYer9/HaAuUrONjujukN4SPS1fMJ2 /CS/idAUKyyVVX5vozoNK2JVC1h1zUAVsdnmhEzNPsvBoqcVNfyqBFROEVLIPwq+lQMGNVjH ekLTKRWf59MEhUC2ztjSKkGmwdg73d6xSXMuq45EgIJV2wPvOgWQonoHH/kxABEBAAHCwWUE GAECAA8FAlVwZcYCGwwFCRLMAwAACgkQGZU1PhKYC34w5A//YViBtZyDV5O+SJT9FFO3lb9x Zdxf0trA3ooCt7gdBkdnBM6T5EmjgVZ3KYYyFfwXZVkteuCCycMF/zVw5eE9FL1+zz9gg663 nY9q2F77TZTKXVWOLlOV2bY+xaK94U4ytogOGhh9b4UnQ/Ct3+6aviCF78Go608BXbmF/GVT 7uhddemk7ItxM1gE5Hscx3saxGKlayaOsdPKeGTVJCDEtHDuOc7/+jGh5Zxpk/Hpi+DUt1ot 8e6hPYLIQa4uVx4f1xxxV858PQ7QysSLr9pTV7FAQ18JclCaMc7JWIa3homZQL/MNKOfST0S 2e+msuRwQo7AnnfFKBUtb02KwpA4GhWryhkjUh/kbVc1wmGxaU3DgXYQ5GV5+Zf4kk/wqr/7 KG0dkTz6NLCVLyDlmAzuFhf66DJ3zzz4yIo3pbDYi3HB/BwJXVSKB3Ko0oUo+6/qMrOIS02L s++QE/z7K12CCcs7WwOjfCYHK7VtE0Sr/PfybBdTbuDncOuAyAIeIKxdI2nmQHzl035hhvQX s4CSghsP319jAOQiIolCeSbTMD4QWMK8RL/Pe1FI1jC3Nw9s+jq8Dudtbcj2UwAP/STUEbJ9 5rznzuuhPjE0e++EU/RpWmcaIMK/z1zZDMN+ce2v1qzgV936ZhJ3iaVzyqbEE81gDxg3P+IM kiYh4ZtPB4Q= Message-ID: <31782859-a38f-4960-f112-563aa9c378c3@freebsd.org> Date: Sun, 7 Oct 2018 14:46:55 -0400 User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:52.0) Gecko/20100101 Thunderbird/52.9.1 MIME-Version: 1.0 In-Reply-To: Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="cQ6Bg5sx7ZPt6HWqzCgxqCaWNUdKh6XCt" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 07 Oct 2018 18:46:57 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --cQ6Bg5sx7ZPt6HWqzCgxqCaWNUdKh6XCt Content-Type: multipart/mixed; boundary="uIn32O1qTnhrm9SaSElZPZHHFzrsyGlHk"; protected-headers="v1" From: Allan Jude To: freebsd-virtualization@freebsd.org Message-ID: <31782859-a38f-4960-f112-563aa9c378c3@freebsd.org> Subject: Re: bhyve performance problem with SQL server References: In-Reply-To: --uIn32O1qTnhrm9SaSElZPZHHFzrsyGlHk Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: quoted-printable On 2018-10-07 11:31, Andrea Venturoli wrote: > Hello. >=20 > I've got a FreeBSD 11.2 box running vm-bhyve with two Windows virtual > machines, each with an instance of MS SQL server. >=20 > Everything works fine normally, but there's a specific operation which > will impose an high CPU load on the machine and last several minutes, > when it's expected to get the results in a few seconds. >=20 > I think I have to pass this trouble to the "programming" people, but > before I do that, I'd like to double-check this is not a system problem= =2E >=20 >=20 >=20 > Some notes: >=20 > _ that specific operation will put the two VMs in touch with each other= , > as one will contact the DBMS on the other and import data; however, > that's not the only procedure which does such a thing and the others ar= e > working fine; >=20 > _ during the execution of such procedure, the load on the host rises, a= s > both VMs show high CPU usage (in Task Manager), top shows both bhyve > processes in kqread (but this happens all the time), disk activity > doesn't seem so high; >=20 > _ the box has a Quad-Core CPU and I assigned two cores to each VM (I > have hw.vmm.topology.cores_per_package=3D4 in /boot/loader.conf); >=20 > _ both VMs use virtio-net, with both tap interfaces connected to the > same "virtual switch"; >=20 > _ both VMs use a zvol for their HD. >=20 >=20 >=20 > Before I sentence this is an application level problem, is there some > improvment I could do to the above? Any check or test I should run? >=20 >=20 > =C2=A0bye & Thanks > =C2=A0=C2=A0=C2=A0=C2=A0av. > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to > "freebsd-virtualization-unsubscribe@freebsd.org" What is the 'volblocksize' of your zvol? What block size are you using for the bhyve virtual device? is it virtio-blk or ahci? Can you tell if the problem is related to disk IO? --=20 Allan Jude --uIn32O1qTnhrm9SaSElZPZHHFzrsyGlHk-- --cQ6Bg5sx7ZPt6HWqzCgxqCaWNUdKh6XCt Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.22 (MingW32) iQIcBAEBAgAGBQJbulSfAAoJEBmVNT4SmAt+14YP/jBJSOa9kngAVX46W0dPYIta rGUBRpst2IGwTbgo9X3OULFv2TwHxOoh2r1ki4k/Fm5WDG6EEaVesnA9ghHnXvGz A36LtUociyEiTrvgfm+exSiMpMI2nYJoYJkY+Fr0rYiNn9qCg7nFQ0ylK7wgKiuI tVhsCqAFoE5EDtW+6MEiwR/MiXqzgwAcdi+7OmNf0g3MiBeStFbTZej1+B/3HeQq bPysWmvSFvPALfs3UdZ8RknW3wgyOl0z76yHu4Mt2ZEdd+mtKyR9NF6evn8lz3CP HVXt8LEN6AwdqmGZKDMt3fBn6gDniKHvCLolq8JVFBtpb3u4TPYuAEczQhpJnZ6p 1MFxekS2XY1osUUS6rEo7XKN/Nq8BpkcK1qDT3bfgXcy9NUh9uce95SBeNZ64bbn JX6eYczCxIDCMGp5orrwEROKvWWEX4FupGdDSTkXJ+qSR/4IRf+KGpbOnS9tMvXq VItWFUuQIQs/WcAKQlxlrHuvE4pMuM192teBPDCAYyF6vWcCMvW9uyPcaJSlAF28 IGAjpMMLt1Jb5GgNUlgd/nZ7HztBpHDlRijnOVjlU7m6tQ56EgawtVN6WSCqtVS7 heODZNQ2L2Lg+8UIrTtCrbmVFF7yW7usCXGPhVQEYXN4Mv5zuzAn/mdbVaySasKp +zyoqaH01swVw2LDk/Kg =9qIM -----END PGP SIGNATURE----- --cQ6Bg5sx7ZPt6HWqzCgxqCaWNUdKh6XCt-- From owner-freebsd-virtualization@freebsd.org Mon Oct 8 09:29:02 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7124310B91B5 for ; Mon, 8 Oct 2018 09:29:02 +0000 (UTC) (envelope-from matt.churchyard@userve.net) Received: from smtp-b.userve.net (smtp-outbound.userve.net [217.196.1.22]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.userve.net", Issuer "Thawte RSA CA 2018" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 119DE82268 for ; Mon, 8 Oct 2018 09:29:01 +0000 (UTC) (envelope-from matt.churchyard@userve.net) Received: from owa.usd-group.com (owa.usd-group.com [217.196.1.2]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by smtp-b.userve.net (Postfix) with ESMTPS id 91298B4B; Mon, 8 Oct 2018 10:28:53 +0100 (BST) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=userve.net; s=201508; t=1538990933; bh=iLQEtVOH4LhlYOLiQnv68a7JCH7VLQqymtSw7esaDa0=; h=From:To:Subject:Date:References:In-Reply-To; b=Y4t01tWgnR1lVPLlgtR+7+gGVvGFR7+u161slfHXDYS7tiqWeSoxFLZwqKKQ+0dBo AVPlrnxWTfNCeoTpEqDxaRHN2Zw+RbueKZ3tPfhRd3JR7a5YxewlmqPFEVIFacHPnv euJGxtVo1oe/ngGn/yb0SgyXSIBWI1RJFatJqCys= Received: from SERVER.ad.usd-group.com (192.168.0.1) by SERVER.ad.usd-group.com (192.168.0.1) with Microsoft SMTP Server (TLS) id 15.0.847.32; Mon, 8 Oct 2018 10:28:52 +0100 Received: from SERVER.ad.usd-group.com ([fe80::b19d:892a:6fc7:1c9]) by SERVER.ad.usd-group.com ([fe80::b19d:892a:6fc7:1c9%12]) with mapi id 15.00.0847.030; Mon, 8 Oct 2018 10:28:52 +0100 From: Matt Churchyard To: Xavier Humbert , "freebsd-virtualization@freebsd.org" Subject: RE: Problem installing Ubuntu with vm_byhve Thread-Topic: Problem installing Ubuntu with vm_byhve Thread-Index: AQHUXYNkklXx9QEbMUuD/IisvhhvaKUVFh9A Date: Mon, 8 Oct 2018 09:28:52 +0000 Message-ID: <5781057012064b52bd477a381271e512@SERVER.ad.usd-group.com> References: <55fd7896-d17c-88a2-ee07-70d8da9ed5ef@xavierhumbert.net> In-Reply-To: <55fd7896-d17c-88a2-ee07-70d8da9ed5ef@xavierhumbert.net> Accept-Language: en-GB, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [192.168.0.10] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 08 Oct 2018 09:29:02 -0000 >Hi all, >First, I must admit I'm not a byve guru, but I got a pfSense vm installed = and running, so the problem is not my host. >I started with an old release to avoid URFI problems >What I've done : ># vm create ubuntu ># vm install ubuntu ubuntu-12.04.5-server-amd64.iso Starting ubuntu > * found guest in /vms/ubuntu > * booting... ># vm console ubuntu >Consoles: userboot > ... >my config file is straight from .templates : ># cat ubuntu/ubuntu.conf >loader=3D"bhyveload" >cpu=3D1 >memory=3D256M >network0_type=3D"virtio-net" >network0_switch=3D"public" >disk0_type=3D"virtio-blk" >disk0_name=3D"disk0.img" The main issue is that you're trying to use the freebsd loader (bhyveload) = for Linux. You need to use grub or UEFI for Linux. You could start by trying the Ubuntu template, although you may find you ne= ed to provide grub commands in order to get the guest to boot. See https://github.com/churchers/vm-bhyve/wiki/Configuring-Grub-Guests for = more info on booting with grub # vm create -t ubuntu ubuntu-guest If the guest won't boot without manually specifying Grub commands, you may = actually find it easier to use a newer version of Linux and boot with UEFI. Matt >Thanks for any help >Regards, -- Xavier HUMBERT _______________________________________________ freebsd-virtualization@freebsd.org mailing list https://lists.freebsd.org/m= ailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freebs= d.org" From owner-freebsd-virtualization@freebsd.org Mon Oct 8 13:36:07 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2A96C10BF6CC for ; Mon, 8 Oct 2018 13:36:07 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) Received: from admin.sibptus.ru (admin.sibptus.ru [IPv6:2001:19f0:5001:21dc:5400:1ff:feaf:6afb]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id C47C48ABDF for ; Mon, 8 Oct 2018 13:36:06 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) Received: from vas by admin.sibptus.ru with local (Exim 4.91 (FreeBSD)) (envelope-from ) id 1g9Vhc-000K90-1V; Mon, 08 Oct 2018 20:36:04 +0700 Date: Mon, 8 Oct 2018 20:36:04 +0700 From: Victor Sudakov To: Josias =?iso-8859-1?Q?L=2E_Gon=E7alves?= , freebsd-virtualization@freebsd.org Subject: Re: [vm-bhyve] Does anyone have a vm template for Linux Mint ? Message-ID: <20181008133604.GA77358@admin.sibptus.ru> References: <20181006141906.GA10597@admin.sibptus.ru> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: X-PGP-Key: http://www.dreamwidth.org/pubkey?user=victor_sudakov X-PGP-Fingerprint: 10E3 1171 1273 E007 C2E9 3532 0DA4 F259 9B5E C634 User-Agent: Mutt/1.10.1 (2018-07-13) Sender: Victor Sudakov X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 08 Oct 2018 13:36:07 -0000 Josias L. Gonçalves wrote: > My ubuntu is something like that: > > uefi="csm" ^^^^^^^^^^^^^^^^^^^ This is supposed to be the key feature! I did not know about UEFI-CSM. However, when I start the vm: # vm install mint linuxmint-19-cinnamon-64bit-v2.iso Starting mint * found guest in /d02/vm/mint * booting... the TightVNC "console" is just a blank rectangle. Nothing ever happens. Is there anything else I'm missing? The vm is shown as running: mint default uefi 1 2G 0.0.0.0:5909 No Running (81329) My config (a copy of yours): guest="linux" uefi="csm" cpu=1 memory=2G network0_type="virtio-net" network0_switch="public" disk0_type="virtio-blk" disk0_name="disk0.img" # VNC graphics="yes" graphics_wait="no" graphics_res="1280x720" graphics_port="5909" graphics_listen="0.0.0.0" #xhci_mouse="yes" uuid="f9bbfaab-cafc-11e8-8d16-5404a6b49a66" network0_mac="58:9c:fc:08:91:3d" -- Victor Sudakov, VAS4-RIPE, VAS47-RIPN 2:5005/49@fidonet http://vas.tomsk.ru/ From owner-freebsd-virtualization@freebsd.org Mon Oct 8 14:38:07 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B917E10C0FAC for ; Mon, 8 Oct 2018 14:38:07 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) Received: from admin.sibptus.ru (admin.sibptus.ru [IPv6:2001:19f0:5001:21dc:5400:1ff:feaf:6afb]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 5E4938CC60 for ; Mon, 8 Oct 2018 14:38:07 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) Received: from vas by admin.sibptus.ru with local (Exim 4.91 (FreeBSD)) (envelope-from ) id 1g9Wfe-000KT8-3B; Mon, 08 Oct 2018 21:38:06 +0700 Date: Mon, 8 Oct 2018 21:38:06 +0700 From: Victor Sudakov To: Josias =?iso-8859-1?Q?L=2E_Gon=E7alves?= , freebsd-virtualization@freebsd.org Subject: Re: [vm-bhyve] Does anyone have a vm template for Linux Mint ? Message-ID: <20181008143806.GA78665@admin.sibptus.ru> References: <20181006141906.GA10597@admin.sibptus.ru> <20181008133604.GA77358@admin.sibptus.ru> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <20181008133604.GA77358@admin.sibptus.ru> X-PGP-Key: http://www.dreamwidth.org/pubkey?user=victor_sudakov X-PGP-Fingerprint: 10E3 1171 1273 E007 C2E9 3532 0DA4 F259 9B5E C634 User-Agent: Mutt/1.10.1 (2018-07-13) Sender: Victor Sudakov X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 08 Oct 2018 14:38:07 -0000 Victor Sudakov wrote: > Josias L. Gonçalves wrote: > > My ubuntu is something like that: > > > > uefi="csm" > ^^^^^^^^^^^^^^^^^^^ > > This is supposed to be the key feature! I did not know about UEFI-CSM. > > However, when I start the vm: > > # vm install mint linuxmint-19-cinnamon-64bit-v2.iso > Starting mint > * found guest in /d02/vm/mint > * booting... > > > the TightVNC "console" is just a blank rectangle. Nothing ever happens. I get the same blank rectangle with Ubuntu (vm install mint ubuntu-16.04-desktop-amd64.iso) So there must be something amiss in my setup. -- Victor Sudakov, VAS4-RIPE, VAS47-RIPN 2:5005/49@fidonet http://vas.tomsk.ru/ From owner-freebsd-virtualization@freebsd.org Mon Oct 8 14:52:35 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id CE47810C1834 for ; Mon, 8 Oct 2018 14:52:35 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) Received: from admin.sibptus.ru (admin.sibptus.ru [IPv6:2001:19f0:5001:21dc:5400:1ff:feaf:6afb]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id E6D338D7A6 for ; Mon, 8 Oct 2018 14:52:34 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) Received: from vas by admin.sibptus.ru with local (Exim 4.91 (FreeBSD)) (envelope-from ) id 1g9Wtd-000KWD-F5; Mon, 08 Oct 2018 21:52:33 +0700 Date: Mon, 8 Oct 2018 21:52:33 +0700 From: Victor Sudakov To: Josias =?iso-8859-1?Q?L=2E_Gon=E7alves?= , freebsd-virtualization@freebsd.org Subject: Re: [vm-bhyve] Does anyone have a vm template for Linux Mint ? Message-ID: <20181008145233.GA78859@admin.sibptus.ru> References: <20181006141906.GA10597@admin.sibptus.ru> <20181008133604.GA77358@admin.sibptus.ru> <20181008143806.GA78665@admin.sibptus.ru> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <20181008143806.GA78665@admin.sibptus.ru> X-PGP-Key: http://www.dreamwidth.org/pubkey?user=victor_sudakov X-PGP-Fingerprint: 10E3 1171 1273 E007 C2E9 3532 0DA4 F259 9B5E C634 User-Agent: Mutt/1.10.1 (2018-07-13) Sender: Victor Sudakov X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 08 Oct 2018 14:52:36 -0000 Victor Sudakov wrote: > Victor Sudakov wrote: > > Josias L. Gonçalves wrote: > > > My ubuntu is something like that: > > > > > > uefi="csm" > > ^^^^^^^^^^^^^^^^^^^ > > > > This is supposed to be the key feature! I did not know about UEFI-CSM. > > > > However, when I start the vm: > > > > # vm install mint linuxmint-19-cinnamon-64bit-v2.iso > > Starting mint > > * found guest in /d02/vm/mint > > * booting... > > > > > > the TightVNC "console" is just a blank rectangle. Nothing ever happens. > > I get the same blank rectangle with Ubuntu (vm install mint ubuntu-16.04-desktop-amd64.iso) > So there must be something amiss in my setup. The log: окт. 08 21:46:29: initialising окт. 08 21:46:29: [loader: none] окт. 08 21:46:29: [uefi: csm] окт. 08 21:46:29: [cpu: 1] окт. 08 21:46:29: [memory: 2G] окт. 08 21:46:29: [hostbridge: standard] окт. 08 21:46:29: [com ports: com1] окт. 08 21:46:29: [uuid: f9bbfaab-cafc-11e8-8d16-5404a6b49a66] окт. 08 21:46:29: [utctime: yes] окт. 08 21:46:29: [debug mode: no] окт. 08 21:46:29: [primary disk: disk0.img] окт. 08 21:46:29: [primary disk dev: file] окт. 08 21:46:29: initialising network device tap1 окт. 08 21:46:29: adding tap1 -> bridge0 (main addm) окт. 08 21:46:29: bring up tap1 -> bridge0 (main addm) окт. 08 21:46:29: booting окт. 08 21:46:29: [bhyve options: -c 1 -m 2G -Hwl bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI_CSM.fd -U f9bbfaab-cafc-11e8-8d16-5404a6b49a66 -u] окт. 08 21:46:29: [bhyve devices: -s 0,hostbridge -s 31,lpc -s 4:0,virtio-blk,/d02/vm/mint/disk0.img -s 5:0,virtio-net,tap1,mac=58:9c:fc:08:91:3d -s 6:0,fbuf,tcp=0.0.0.0:5909,wait] окт. 08 21:46:29: [bhyve console: -l com1,/dev/nmdm-mint.1A] окт. 08 21:46:29: [bhyve iso device: -s 3:0,ahci-cd,/d02/vm/.iso/ubuntu-16.04-desktop-amd64.iso] окт. 08 21:46:29: starting bhyve (run 1) окт. 08 21:50:08: bhyve exited with status 143 окт. 08 21:50:08: destroying network device tap1 окт. 08 21:50:08: stopped I waited about 4 minutes before sending "vm mint stop" looking into the blank VNC console. -- Victor Sudakov, VAS4-RIPE, VAS47-RIPN 2:5005/49@fidonet http://vas.tomsk.ru/ From owner-freebsd-virtualization@freebsd.org Mon Oct 8 21:01:31 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 54F7C10CB4C1 for ; Mon, 8 Oct 2018 21:01:31 +0000 (UTC) (envelope-from josiaslg@bsd.com.br) Received: from mail-pf1-x435.google.com (mail-pf1-x435.google.com [IPv6:2607:f8b0:4864:20::435]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id D1DF57D188 for ; Mon, 8 Oct 2018 21:01:30 +0000 (UTC) (envelope-from josiaslg@bsd.com.br) Received: by mail-pf1-x435.google.com with SMTP id u12-v6so5785011pfn.12 for ; Mon, 08 Oct 2018 14:01:30 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsd.com.br; s=capeta; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=Vcs9uBE7qvPOXf30JQwaGSe1lEopms3J4du6ov4m7So=; b=ZOGSa2VWKfpMpoEk6ZjewA5uPZaJLHSJA8yXfiTS7dMh/voB47aLdX8kre5BO9NqMa G7NYqUzb0S71dpfEjEDwXfnl34kLGxMX7/9Al4EQ0VRAvY841TwkfZwumiRPD188aT9m IbcNLPok2s37N1I5k3FUfMxfhJR2iuAxISauA= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=Vcs9uBE7qvPOXf30JQwaGSe1lEopms3J4du6ov4m7So=; b=OVgdq8ZAkMe4L7gk/pXtNhkLM+l09+m+FiQC8jEFn/gL6HpDzA83nhVlQQqDrBY4EK MGerSIuEnK2OA4LoW+wjV9r0m2L51dmvCK44Jbb9wK3olYAxaBiyaHawhPzabr2uOnIr o5wHaAlO0F9KjfduZ8TNms1Q6YIet3eq38ln9ycB3svzquKw51w9GrMc6vnvOR0zKmig EsZiURDO7NRrEFJNWXw63E7j4+Wtz/PlSDir+fReIWPrRNb4fB+nahVCqh3RKVTlISRy pfUyRu1IZZa8E6rMG8ODl+zUsByWS7a8I9EOfxyc9dfx7PyWw5eWGXVx8nqDL6/LUH6w 97Cw== X-Gm-Message-State: ABuFfogPxkxCp5q6fYaVkOFVtcyYcVJW82qQUEMVBodhzPZ+IVZtsNU3 LmT3N5kMMEKm861Aio1bc9u0cV2BwOw44TmyNjb4lNhvyvI= X-Google-Smtp-Source: ACcGV606xTAUTvCUU7A+zzMN0HB6aDbGiFZJQ7hWveJ8XIR3Xt2RTKbtotx/i5svMlYR9KlLKy60n65gep2sUO6ZrVg= X-Received: by 2002:a63:8a41:: with SMTP id y62-v6mr22413249pgd.420.1539032488969; Mon, 08 Oct 2018 14:01:28 -0700 (PDT) MIME-Version: 1.0 References: <20181006141906.GA10597@admin.sibptus.ru> <20181008133604.GA77358@admin.sibptus.ru> <20181008143806.GA78665@admin.sibptus.ru> <20181008145233.GA78859@admin.sibptus.ru> In-Reply-To: <20181008145233.GA78859@admin.sibptus.ru> From: =?UTF-8?Q?Josias_L=2E_Gon=C3=A7alves?= Date: Mon, 8 Oct 2018 18:01:17 -0300 Message-ID: Subject: Re: [vm-bhyve] Does anyone have a vm template for Linux Mint ? To: vas@mpeks.tomsk.su Cc: freebsd-virtualization@freebsd.org Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.27 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 08 Oct 2018 21:01:31 -0000 Em seg, 8 de out de 2018 =C3=A0s 11:52, Victor Sudakov escreveu: > Victor Sudakov wrote: > > Victor Sudakov wrote: > > > Josias L. Gon=C3=A7alves wrote: > > > > My ubuntu is something like that: > > > > > > > > uefi=3D"csm" > > > ^^^^^^^^^^^^^^^^^^^ > > > > > > This is supposed to be the key feature! I did not know about UEFI-CSM= . > > > > > > However, when I start the vm: > > > > > > # vm install mint linuxmint-19-cinnamon-64bit-v2.iso > > > Starting mint > > > * found guest in /d02/vm/mint > > > * booting... > > > > > > > > > the TightVNC "console" is just a blank rectangle. Nothing ever > happens. > > > > I get the same blank rectangle with Ubuntu (vm install mint > ubuntu-16.04-desktop-amd64.iso) > > So there must be something amiss in my setup. > > The log: > > > =D0=BE=D0=BA=D1=82. 08 21:46:29: initialising > =D0=BE=D0=BA=D1=82. 08 21:46:29: [loader: none] > =D0=BE=D0=BA=D1=82. 08 21:46:29: [uefi: csm] > =D0=BE=D0=BA=D1=82. 08 21:46:29: [cpu: 1] > =D0=BE=D0=BA=D1=82. 08 21:46:29: [memory: 2G] > =D0=BE=D0=BA=D1=82. 08 21:46:29: [hostbridge: standard] > =D0=BE=D0=BA=D1=82. 08 21:46:29: [com ports: com1] > =D0=BE=D0=BA=D1=82. 08 21:46:29: [uuid: f9bbfaab-cafc-11e8-8d16-5404a6b4= 9a66] > =D0=BE=D0=BA=D1=82. 08 21:46:29: [utctime: yes] > =D0=BE=D0=BA=D1=82. 08 21:46:29: [debug mode: no] > =D0=BE=D0=BA=D1=82. 08 21:46:29: [primary disk: disk0.img] > =D0=BE=D0=BA=D1=82. 08 21:46:29: [primary disk dev: file] > =D0=BE=D0=BA=D1=82. 08 21:46:29: initialising network device tap1 > =D0=BE=D0=BA=D1=82. 08 21:46:29: adding tap1 -> bridge0 (main addm) > =D0=BE=D0=BA=D1=82. 08 21:46:29: bring up tap1 -> bridge0 (main addm) > =D0=BE=D0=BA=D1=82. 08 21:46:29: booting > =D0=BE=D0=BA=D1=82. 08 21:46:29: [bhyve options: -c 1 -m 2G -Hwl > bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI_CSM.fd -U > f9bbfaab-cafc-11e8-8d16-5404a6b49a66 -u] > =D0=BE=D0=BA=D1=82. 08 21:46:29: [bhyve devices: -s 0,hostbridge -s 31,l= pc -s > 4:0,virtio-blk,/d02/vm/mint/disk0.img -s > 5:0,virtio-net,tap1,mac=3D58:9c:fc:08:91:3d -s 6:0,fbuf,tcp=3D0.0.0.0:590= 9 > ,wait] > =D0=BE=D0=BA=D1=82. 08 21:46:29: [bhyve console: -l com1,/dev/nmdm-mint.= 1A] > =D0=BE=D0=BA=D1=82. 08 21:46:29: [bhyve iso device: -s > 3:0,ahci-cd,/d02/vm/.iso/ubuntu-16.04-desktop-amd64.iso] > =D0=BE=D0=BA=D1=82. 08 21:46:29: starting bhyve (run 1) > =D0=BE=D0=BA=D1=82. 08 21:50:08: bhyve exited with status 143 > =D0=BE=D0=BA=D1=82. 08 21:50:08: destroying network device tap1 > =D0=BE=D0=BA=D1=82. 08 21:50:08: stopped > > I waited about 4 minutes before sending "vm mint stop" looking into > the blank VNC console. > > -- > Victor Sudakov, VAS4-RIPE, VAS47-RIPN > 2:5005/49@fidonet http://vas.tomsk.ru/ Verify if everything is installed: pkg install bhyve-firmware-1.0_1 bhyve-rc-3 grub2-bhyve-0.40_5 libhyve-remote-0.1.4.2 uefi-edk2-bhyve-0.1,1 uefi-edk2-bhyve-csm-0.1,1 From owner-freebsd-virtualization@freebsd.org Mon Oct 8 22:14:53 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8BC1110CDAA8 for ; Mon, 8 Oct 2018 22:14:53 +0000 (UTC) (envelope-from darcy@druid.net) Received: from mail.vex.net (mail.vex.net [IPv6:2605:2600:1001::44]) by mx1.freebsd.org (Postfix) with ESMTP id 3EA408214F for ; Mon, 8 Oct 2018 22:14:49 +0000 (UTC) (envelope-from darcy@druid.net) Received: from dilbert.druid.net (dilbert.druid.net [207.35.13.14]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) (Authenticated sender: darcy) by mail.vex.net (Postfix) with ESMTPSA id F0C694A459BB for ; Mon, 8 Oct 2018 18:14:42 -0400 (EDT) From: D'Arcy Cain Openpgp: preference=signencrypt Subject: Error installing Xubuntu under bhyve To: FreeBSD-virtualization@FreeBSD.org Message-ID: <21bcfbf0-e0f9-0250-097d-5a5b2e372056@druid.net> Date: Mon, 8 Oct 2018 18:14:42 -0400 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:60.0) Gecko/20100101 Thunderbird/60.0 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 08 Oct 2018 22:14:53 -0000 I asked this in another email but I guess it was buried in the other issue I was talking about so I thought that I would start a new thread. I am trying to install Xubuntu under bhyve with vm-bhyve. The install goes fine right up to near the end when it fails with a "Executing 'grub-install /dev/vda' failed" error and the install fails. A second attempt says that there is a system already on the disk but it won't boot up and leaves the console at a grub prompt. I have grub2-bhyve installed. Here is my config: guest="linux" uefi="yes" loader="grub" grub_run_partition="msdos1" cpu=2 memory=1024 network0_type="virtio-net" network0_switch="public" network0_mac="22:22:22:22:22:03" disk0_type="virtio-blk" disk0_name="disk0.img" uuid="532fb166-c1bb-11e8-9e80-b4b52fcc4894" graphics="yes" xhci_mouse="yes" -- D'Arcy J.M. Cain | Democracy is three wolves http://www.druid.net/darcy/ | and a sheep voting on +1 416 788 2246 (DoD#0082) (eNTP) | what's for dinner. IM: darcy@Vex.Net, VoIP: sip:darcy@druid.net From owner-freebsd-virtualization@freebsd.org Tue Oct 9 02:17:15 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0E5E710B6EAE for ; Tue, 9 Oct 2018 02:17:15 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) Received: from admin.sibptus.ru (admin.sibptus.ru [IPv6:2001:19f0:5001:21dc:5400:1ff:feaf:6afb]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 989EB8E9B1 for ; Tue, 9 Oct 2018 02:17:14 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) Received: from vas by admin.sibptus.ru with local (Exim 4.91 (FreeBSD)) (envelope-from ) id 1g9haD-000N21-4i; Tue, 09 Oct 2018 09:17:13 +0700 Date: Tue, 9 Oct 2018 09:17:13 +0700 From: Victor Sudakov To: Josias =?iso-8859-1?Q?L=2E_Gon=E7alves?= Cc: freebsd-virtualization@freebsd.org Subject: Re: [vm-bhyve] Does anyone have a vm template for Linux Mint ? Message-ID: <20181009021713.GA88207@admin.sibptus.ru> References: <20181006141906.GA10597@admin.sibptus.ru> <20181008133604.GA77358@admin.sibptus.ru> <20181008143806.GA78665@admin.sibptus.ru> <20181008145233.GA78859@admin.sibptus.ru> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: X-PGP-Key: http://www.dreamwidth.org/pubkey?user=victor_sudakov X-PGP-Fingerprint: 10E3 1171 1273 E007 C2E9 3532 0DA4 F259 9B5E C634 User-Agent: Mutt/1.10.1 (2018-07-13) Sender: Victor Sudakov X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 09 Oct 2018 02:17:15 -0000 Josias L. Gonçalves wrote: > > > I get the same blank rectangle with Ubuntu (vm install mint > > > ubuntu-16.04-desktop-amd64.iso) > > > So there must be something amiss in my setup. > > > Verify if everything is installed: > pkg install bhyve-firmware-1.0_1 bhyve-rc-3 grub2-bhyve-0.40_5 > libhyve-remote-0.1.4.2 uefi-edk2-bhyve-0.1,1 uefi-edk2-bhyve-csm-0.1,1 Well, not everything from your list. I have currently root@vas:~ # pkg info -a | egrep 'bhyve|uefi' grub2-bhyve-0.40_4 Grub-emu loader for bhyve uefi-edk2-bhyve-0.1,1 UEFI-EDK2 firmware for bhyve uefi-edk2-bhyve-csm-0.1,1 UEFI-EDK2 firmware for bhyve with CSM vm-bhyve-1.2.3 Management system for bhyve virtual machines root@vas:~ # bhyve-firmware: is a metaport for uefi-edk2-bhyve and uefi-edk2-bhyve-csm, I already have them both installed. But no harm installing it also. bhyve-rc-3: "FreeBSD RC script for starting bhyve guests in tmux" - I definitely don't need it because I use vm-bhyve for VM management. libhyve-remote-0.1.4.2: well, maybe this one is the culprit. We shall see tonight if its presence makes any difference. -- Victor Sudakov, VAS4-RIPE, VAS47-RIPN 2:5005/49@fidonet http://vas.tomsk.ru/ From owner-freebsd-virtualization@freebsd.org Tue Oct 9 08:24:42 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 006FD10C540D for ; Tue, 9 Oct 2018 08:24:42 +0000 (UTC) (envelope-from xavier@xavierhumbert.net) Received: from aragorn.amdh.fr (aragorn.groumpf.org [176.31.180.205]) by mx1.freebsd.org (Postfix) with ESMTP id 8005B7CBF9 for ; Tue, 9 Oct 2018 08:24:40 +0000 (UTC) (envelope-from xavier@xavierhumbert.net) Received: from numenor.groumpf.org (unknown [78.251.129.10]) by aragorn.amdh.fr (Postfix) with ESMTP id A4E2F61F95 for ; Tue, 9 Oct 2018 10:24:32 +0200 (CEST) Received: from numenor.groumpf.org (localhost [127.0.0.1]) by numenor.groumpf.org (Postfix) with ESMTP id 108D14D9E for ; Tue, 9 Oct 2018 10:24:32 +0200 (CEST) X-Virus-Scanned: amavisd-new at groumpf.org Received: from numenor.groumpf.org ([127.0.0.1]) by numenor.groumpf.org (ns3.groumpf.org [127.0.0.1]) (amavisd-new, port 10024) with LMTP id MMva0SaIyyi1 for ; Tue, 9 Oct 2018 10:22:30 +0200 (CEST) Received: from [192.168.100.21] (unknown [192.168.100.21]) by numenor.groumpf.org (Postfix) with ESMTPS id AB328AA1 for ; Mon, 8 Oct 2018 20:28:21 +0200 (CEST) Subject: Re: Problem installing Ubuntu with vm_byhve To: "freebsd-virtualization@freebsd.org" References: <55fd7896-d17c-88a2-ee07-70d8da9ed5ef@xavierhumbert.net> <5781057012064b52bd477a381271e512@SERVER.ad.usd-group.com> From: Xavier Humbert Message-ID: Date: Mon, 8 Oct 2018 20:28:21 +0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.9.1 MIME-Version: 1.0 In-Reply-To: <5781057012064b52bd477a381271e512@SERVER.ad.usd-group.com> Content-Type: text/plain; charset=utf-8 Content-Language: fr-classic Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 09 Oct 2018 08:24:42 -0000 On 08/10/2018 11:28, Matt Churchyard wrote: > # vm create -t ubuntu ubuntu-guest Oops, forgot to select the template ! Works much better :-) Thanks -- Xavier HUMBERT From owner-freebsd-virtualization@freebsd.org Tue Oct 9 09:19:39 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8AE3210C6C0B for ; Tue, 9 Oct 2018 09:19:39 +0000 (UTC) (envelope-from matt.churchyard@userve.net) Received: from smtp-a.userve.net (smtp-outbound.userve.net [217.196.1.22]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.userve.net", Issuer "Thawte RSA CA 2018" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 1089C7EAB1 for ; Tue, 9 Oct 2018 09:19:38 +0000 (UTC) (envelope-from matt.churchyard@userve.net) Received: from owa.usd-group.com (owa.usd-group.com [217.196.1.2]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by smtp-a.userve.net (Postfix) with ESMTPS id 099E99A; Tue, 9 Oct 2018 10:19:37 +0100 (BST) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=userve.net; s=201508; t=1539076777; bh=hjOB6sXn/Hlxc0eVevXsg6iXFsUEFcKZcm3p+zKC1VM=; h=From:To:CC:Subject:Date:References:In-Reply-To; b=VsPxmQY82mJjwbJ+lmCBR86kMayCIrzMiTkPp5J0+6ijHDW+xRnRDXo7+kP2ZxfBw HgckWNhNyK2qBRdtYx68BgeZY2Z6dmhjP5Ut4GCGZVJVk/FJavO/SC8orhN045JDNd iQIWnTCzNBmmKpQg4NIvIjYkizEfk3a9O3/y8nyM= Received: from SERVER.ad.usd-group.com (192.168.0.1) by SERVER.ad.usd-group.com (192.168.0.1) with Microsoft SMTP Server (TLS) id 15.0.847.32; Tue, 9 Oct 2018 10:19:36 +0100 Received: from SERVER.ad.usd-group.com ([fe80::b19d:892a:6fc7:1c9]) by SERVER.ad.usd-group.com ([fe80::b19d:892a:6fc7:1c9%12]) with mapi id 15.00.0847.030; Tue, 9 Oct 2018 10:19:36 +0100 From: Matt Churchyard To: Victor Sudakov , =?iso-8859-1?Q?Josias_L=2E_Gon=E7alves?= CC: "freebsd-virtualization@freebsd.org" Subject: RE: [vm-bhyve] Does anyone have a vm template for Linux Mint ? Thread-Topic: [vm-bhyve] Does anyone have a vm template for Linux Mint ? Thread-Index: AQHUXX+uEzZxL7GG50CRQL6QhRq5daUVXQDcgAAASQCAAAQKgIAAZwaAgABYRYCAAH+XgA== Date: Tue, 9 Oct 2018 09:19:36 +0000 Message-ID: References: <20181006141906.GA10597@admin.sibptus.ru> <20181008133604.GA77358@admin.sibptus.ru> <20181008143806.GA78665@admin.sibptus.ru> <20181008145233.GA78859@admin.sibptus.ru> <20181009021713.GA88207@admin.sibptus.ru> In-Reply-To: <20181009021713.GA88207@admin.sibptus.ru> Accept-Language: en-GB, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [192.168.0.10] Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 09 Oct 2018 09:19:39 -0000 Josias L. Gon=E7alves wrote: > > > I get the same blank rectangle with Ubuntu (vm install mint > > > ubuntu-16.04-desktop-amd64.iso) > > > So there must be something amiss in my setup. >=20 >=20 > Verify if everything is installed: > pkg install bhyve-firmware-1.0_1 bhyve-rc-3 grub2-bhyve-0.40_5 > libhyve-remote-0.1.4.2 uefi-edk2-bhyve-0.1,1 uefi-edk2-bhyve-csm-0.1,1 Well, not everything from your list. I have currently >root@vas:~ # pkg info -a | egrep 'bhyve|uefi' >grub2-bhyve-0.40_4 Grub-emu loader for bhyve >uefi-edk2-bhyve-0.1,1 UEFI-EDK2 firmware for bhyve >uefi-edk2-bhyve-csm-0.1,1 UEFI-EDK2 firmware for bhyve with CSM >vm-bhyve-1.2.3 Management system for bhyve virtual machine= s >root@vas:~ # >bhyve-firmware: is a metaport for uefi-edk2-bhyve and uefi-edk2-bhyve-csm,= I already have them both installed. But no harm installing it also. >bhyve-rc-3: "FreeBSD RC script for starting bhyve guests in tmux" - I defi= nitely don't need it because I use vm-bhyve for VM management. >libhyve-remote-0.1.4.2: well, maybe this one is the culprit. We shall see = tonight if its presence makes any difference. As you mention all the required firmware is installed by the bhyve-firmware= port. You do not need to install the edk2 ports. Grub2 is not required either if you're using UEFI, although you'll need it = to run any guests with loader=3D"grub" and there's no harm having it around= if you're using bhyve. I've never heard of libhyve-remote until now. This is an additional compone= nt (something to do with FreeNAS by the look of it) and has nothing to do w= ith the actual running of bhyve or vm-bhyve. Personally I've never had success with the CSM firmware (other that with Sm= artOS which was following instructions from the original bhyve devs). My un= derstanding is that CSM is supposed to emulate a traditional BIOS, so anyth= ing that would boot on a BIOS should work (or at least try to boot). Howeve= r I usually just get a blank screen and nothing else. I have successfully** installed Ubuntu 16.04 (via VNC) using the following = template, which is just a basic UEFI config with virtio network/disk. uefi=3D"yes" graphics=3D"yes" xhci_mouse=3D"yes" cpu=3D2 memory=3D2G network0_type=3D"virtio-net" network0_switch=3D"public" disk0_type=3D"virtio-blk" disk0_name=3D"disk0.img" **I did have two fairly annoying issues getting 16.04 to work - 1) After installation it seemed to refuse to reboot without me removing the= install CD, which I obviously couldn't do. I ended up powering off the sys= tem manually with "vm poweroff guest" 2) It then would not boot due to the fact that Ubuntu 16.04 puts the bootlo= ader in a non-default location, then uses efivars to tell UEFI how to find = it. Unfortunately the bhyve EFI firmware still does not save efivars, so an= y specific boot options set by a guest are lost on restart. I had to escape= to the EFI shell and manually choose the EFI/ubuntu/grubx64.efi loader. Se= e my post #11 on this forum post for more details - https://forums.freebsd.= org/threads/how-to-install-a-ubuntu-guest-in-bhyve.66767/ Matt -- Victor Sudakov, VAS4-RIPE, VAS47-RIPN 2:5005/49@fidonet http://vas.tomsk.ru/ _______________________________________________ freebsd-virtualization@freebsd.org mailing list https://lists.freebsd.org/m= ailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freebs= d.org" From owner-freebsd-virtualization@freebsd.org Tue Oct 9 10:19:47 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9C3C410C89A1 for ; Tue, 9 Oct 2018 10:19:47 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) Received: from admin.sibptus.ru (admin.sibptus.ru [IPv6:2001:19f0:5001:21dc:5400:1ff:feaf:6afb]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 3EB988106B for ; Tue, 9 Oct 2018 10:19:47 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) Received: from vas by admin.sibptus.ru with local (Exim 4.91 (FreeBSD)) (envelope-from ) id 1g9p7A-000O8A-G1; Tue, 09 Oct 2018 17:19:44 +0700 Date: Tue, 9 Oct 2018 17:19:44 +0700 From: Victor Sudakov To: Matt Churchyard Cc: Josias =?iso-8859-1?Q?L=2E_Gon=E7alves?= , "freebsd-virtualization@freebsd.org" Subject: Re: [vm-bhyve] Does anyone have a vm template for Linux Mint ? Message-ID: <20181009101944.GA92701@admin.sibptus.ru> References: <20181006141906.GA10597@admin.sibptus.ru> <20181008133604.GA77358@admin.sibptus.ru> <20181008143806.GA78665@admin.sibptus.ru> <20181008145233.GA78859@admin.sibptus.ru> <20181009021713.GA88207@admin.sibptus.ru> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-PGP-Key: http://www.dreamwidth.org/pubkey?user=victor_sudakov X-PGP-Fingerprint: 10E3 1171 1273 E007 C2E9 3532 0DA4 F259 9B5E C634 User-Agent: Mutt/1.10.1 (2018-07-13) Sender: Victor Sudakov X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 09 Oct 2018 10:19:47 -0000 Matt Churchyard wrote: [dd] > Personally I've never had success with the CSM firmware (other that > with SmartOS which was following instructions from the original > bhyve devs). My understanding is that CSM is supposed to emulate a > traditional BIOS, so anything that would boot on a BIOS should work > (or at least try to boot). I would LOVE to have such a thing! > However I usually just get a blank screen > and nothing else. Same happens to myself. However Josias says he has Ubuntu running with uefi="csm", let's find out his secret! :-) > > I have successfully** installed Ubuntu 16.04 (via VNC) using the following template, which is just a basic UEFI config with virtio network/disk. > > uefi="yes" > graphics="yes" > xhci_mouse="yes" > cpu=2 > memory=2G > network0_type="virtio-net" > network0_switch="public" > disk0_type="virtio-blk" > disk0_name="disk0.img" > > **I did have two fairly annoying issues getting 16.04 to work - Thank you for the hints. Will try them tonight. -- Victor Sudakov, VAS4-RIPE, VAS47-RIPN 2:5005/49@fidonet http://vas.tomsk.ru/ From owner-freebsd-virtualization@freebsd.org Tue Oct 9 10:41:48 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6B1F910C949E for ; Tue, 9 Oct 2018 10:41:48 +0000 (UTC) (envelope-from darcy@druid.net) Received: from mail.vex.net (mail.vex.net [98.158.139.68]) by mx1.freebsd.org (Postfix) with ESMTP id F110B81F65 for ; Tue, 9 Oct 2018 10:41:47 +0000 (UTC) (envelope-from darcy@druid.net) Received: from dilbert.druid.net (dilbert.druid.net [207.35.13.14]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) (Authenticated sender: darcy) by mail.vex.net (Postfix) with ESMTPSA id C36934A478A7 for ; Tue, 9 Oct 2018 06:41:46 -0400 (EDT) Subject: Re: Error installing Xubuntu under bhyve To: freebsd-virtualization@freebsd.org References: <21bcfbf0-e0f9-0250-097d-5a5b2e372056@druid.net> From: D'Arcy Cain Openpgp: preference=signencrypt Message-ID: <6ac9ed7e-8d92-5933-e097-306dc54a01d1@druid.net> Date: Tue, 9 Oct 2018 06:41:46 -0400 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:60.0) Gecko/20100101 Thunderbird/60.0 MIME-Version: 1.0 In-Reply-To: <21bcfbf0-e0f9-0250-097d-5a5b2e372056@druid.net> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 09 Oct 2018 10:41:48 -0000 On 10/8/18 6:14 PM, D'Arcy Cain wrote: > I am trying to install Xubuntu under bhyve with vm-bhyve. The install I had a private email with some suggestions. They didn't work but I thought I should mention them here for discussion purposes. > goes fine right up to near the end when it fails with a "Executing > 'grub-install /dev/vda' failed" error and the install fails. A second > attempt says that there is a system already on the disk but it won't > boot up and leaves the console at a grub prompt. I have grub2-bhyve > installed. Here is my config: > > guest="linux" > uefi="yes" > loader="grub" > grub_run_partition="msdos1" He said that I don't need the grub lines if I am using uefi. Those lines were actually added in as a Hail Mary. In or out made no difference. > disk0_type="virtio-blk" He suggested ahci-hd. It made no difference. He also suggested starting over with a new disk but that didn't help either. Still looking for suggestions. -- D'Arcy J.M. Cain | Democracy is three wolves http://www.druid.net/darcy/ | and a sheep voting on +1 416 788 2246 (DoD#0082) (eNTP) | what's for dinner. IM: darcy@Vex.Net, VoIP: sip:darcy@druid.net From owner-freebsd-virtualization@freebsd.org Tue Oct 9 11:32:32 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 789D810CAA1E for ; Tue, 9 Oct 2018 11:32:32 +0000 (UTC) (envelope-from matt.churchyard@userve.net) Received: from smtp-b.userve.net (smtp-outbound.userve.net [217.196.1.22]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.userve.net", Issuer "Thawte RSA CA 2018" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 15DDA83FB0 for ; Tue, 9 Oct 2018 11:32:31 +0000 (UTC) (envelope-from matt.churchyard@userve.net) Received: from owa.usd-group.com (owa.usd-group.com [217.196.1.2]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by smtp-b.userve.net (Postfix) with ESMTPS id 83DAADE5; Tue, 9 Oct 2018 12:32:25 +0100 (BST) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=userve.net; s=201508; t=1539084745; bh=1TYjlszqVPXLVblDWo3yqqH6Uq+ygl2KiqcAa38wGv4=; h=From:To:Subject:Date:References:In-Reply-To; b=mp7AVaxcOxRauw580jTKj9eYNnnX0g3j0p+DWKGuAv72PE/ES0C4KS+afOwk5A6b7 mnx0oIPDyIygHTiO3yO9eDBIPw0yeEqnRGJZ720S1/D6z3GNO1+eaXFEwdGAtLFI7M NyYkD0MqbhTIn3LTkkeo3neN5IV95Gq1Lgh0B2lI= Received: from SERVER.ad.usd-group.com (192.168.0.1) by SERVER.ad.usd-group.com (192.168.0.1) with Microsoft SMTP Server (TLS) id 15.0.847.32; Tue, 9 Oct 2018 12:32:25 +0100 Received: from SERVER.ad.usd-group.com ([fe80::b19d:892a:6fc7:1c9]) by SERVER.ad.usd-group.com ([fe80::b19d:892a:6fc7:1c9%12]) with mapi id 15.00.0847.030; Tue, 9 Oct 2018 12:32:24 +0100 From: Matt Churchyard To: D'Arcy Cain , "freebsd-virtualization@freebsd.org" Subject: RE: Error installing Xubuntu under bhyve Thread-Topic: Error installing Xubuntu under bhyve Thread-Index: AQHUX1Ro5QfVmsdEvkWPsvsu0GVe0aUWqe0AgAAbcsA= Date: Tue, 9 Oct 2018 11:32:24 +0000 Message-ID: References: <21bcfbf0-e0f9-0250-097d-5a5b2e372056@druid.net> <6ac9ed7e-8d92-5933-e097-306dc54a01d1@druid.net> In-Reply-To: <6ac9ed7e-8d92-5933-e097-306dc54a01d1@druid.net> Accept-Language: en-GB, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [192.168.0.10] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 09 Oct 2018 11:32:32 -0000 On 10/8/18 6:14 PM, D'Arcy Cain wrote: > I am trying to install Xubuntu under bhyve with vm-bhyve. The install >I had a private email with some suggestions. They didn't work but I thoug= ht I should mention them here for discussion purposes. > goes fine right up to near the end when it fails with a "Executing=20 > 'grub-install /dev/vda' failed" error and the install fails. A second=20 > attempt says that there is a system already on the disk but it won't=20 > boot up and leaves the console at a grub prompt. I have grub2-bhyve=20 > installed. Here is my config: >=20 > guest=3D"linux" > uefi=3D"yes" > loader=3D"grub" > grub_run_partition=3D"msdos1" >He said that I don't need the grub lines if I am using uefi. Those lines = were actually added in as a Hail Mary. In or out made no difference. Yes, all grub settings are irrelevant if you are using UEFI. With UEFI, the= UEFI firmware is used instead of grub2-bhyve (even if the guest boots from= UEFI into grub internally). As such, the loader=3D"grub" option isn't actually needed here either. Also the "guest" configuration option was removed quite a while ago I was able to install XUbuntu with a simple UEFI + graphics config and usin= g the graphical installer via VNC - uefi=3D"yes" graphics=3D"yes" xhci_mouse=3D"yes" cpu=3D1 memory=3D512M network0_type=3D"virtio-net" network0_switch=3D"public" disk0_type=3D"virtio-blk" disk0_name=3D"disk0.img" > disk0_type=3D"virtio-blk" >He suggested ahci-hd. It made no difference. >He also suggested starting over with a new disk but that didn't help eithe= r. >Still looking for suggestions. --=20 D'Arcy J.M. Cain | Democracy is three wolves http://www.druid.net/darcy/ | and a sheep voting on +1 416 788 2246 (DoD#0082) (eNTP) | what's for dinner. IM: darcy@Vex.Net, VoIP: sip:darcy@druid.net ______________________________= _________________ freebsd-virtualization@freebsd.org mailing list https://lists.freebsd.org/m= ailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freebs= d.org" From owner-freebsd-virtualization@freebsd.org Tue Oct 9 12:25:49 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8D53710CD0C2 for ; Tue, 9 Oct 2018 12:25:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 29D958611E for ; Tue, 9 Oct 2018 12:25:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id E2F5810CD0C1; Tue, 9 Oct 2018 12:25:48 +0000 (UTC) Delivered-To: virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D1A8C10CD0C0 for ; Tue, 9 Oct 2018 12:25:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 71C518611C for ; Tue, 9 Oct 2018 12:25:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id B932C12F27 for ; Tue, 9 Oct 2018 12:25:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w99CPlsT079981 for ; Tue, 9 Oct 2018 12:25:47 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w99CPlvJ079980 for virtualization@FreeBSD.org; Tue, 9 Oct 2018 12:25:47 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 229852] [PATCH] bhyve: IOMMU (Intel VTd) PCI passthrough attempt locks up some systems Date: Tue, 09 Oct 2018 12:25:47 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.2-RELEASE X-Bugzilla-Keywords: patch X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: t_uemura@macome.co.jp X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 09 Oct 2018 12:25:49 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D229852 t_uemura@macome.co.jp changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |t_uemura@macome.co.jp --- Comment #2 from t_uemura@macome.co.jp --- I had the same issue on my Shuttle DS77U mini-PC (Intel Celeron 3865U; Sunrise Point-LP chipset) and the patch fixes the issue perfectly. Both of my host and guest run 11.2-STABLE as of 28th Sep.. Someone please make sure there's no side effect and commit/MFC. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Tue Oct 9 13:41:42 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 076DB10CF456 for ; Tue, 9 Oct 2018 13:41:42 +0000 (UTC) (envelope-from xavier@xavierhumbert.net) Received: from aragorn.amdh.fr (aragorn.groumpf.org [176.31.180.205]) by mx1.freebsd.org (Postfix) with ESMTP id 9EF8489981 for ; Tue, 9 Oct 2018 13:41:41 +0000 (UTC) (envelope-from xavier@xavierhumbert.net) Received: from numenor.groumpf.org (unknown [78.251.129.10]) by aragorn.amdh.fr (Postfix) with ESMTP id C7E5661F95 for ; Tue, 9 Oct 2018 15:41:38 +0200 (CEST) Received: from numenor.groumpf.org (localhost [127.0.0.1]) by numenor.groumpf.org (Postfix) with ESMTP id 4A1DF67E0 for ; Tue, 9 Oct 2018 15:41:38 +0200 (CEST) X-Virus-Scanned: amavisd-new at groumpf.org Received: from numenor.groumpf.org ([127.0.0.1]) by numenor.groumpf.org (ns3.groumpf.org [127.0.0.1]) (amavisd-new, port 10024) with LMTP id 3byuIcA4FRlK for ; Tue, 9 Oct 2018 15:41:26 +0200 (CEST) Received: from [192.168.100.21] (unknown [192.168.100.21]) by numenor.groumpf.org (Postfix) with ESMTPS id D132067DA for ; Tue, 9 Oct 2018 15:41:26 +0200 (CEST) Subject: Re: Problem installing Ubuntu with vm_byhve From: Xavier Humbert To: "freebsd-virtualization@freebsd.org" References: <55fd7896-d17c-88a2-ee07-70d8da9ed5ef@xavierhumbert.net> <5781057012064b52bd477a381271e512@SERVER.ad.usd-group.com> Message-ID: <42348955-c095-01ca-ae07-69bf77be4c96@xavierhumbert.net> Date: Tue, 9 Oct 2018 15:41:15 +0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.9.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Language: fr-classic Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 09 Oct 2018 13:41:42 -0000 On 08/10/2018 20:28, Xavier Humbert wrote: > On 08/10/2018 11:28, Matt Churchyard wrote: >> # vm create -t ubuntu ubuntu-guest > > Oops, forgot to select the template ! > > Works much better :-) > > Thanks > Well it now boots and install, but when I reboot, I drop into grub. Managed it with this mantra : grub> set root=(hd0,gpt2) grub> set prefix=(hd0,gpt2)/boot/grub grub>insmod normal grub>normal How can I fix autoboot ? The actual ubuntu.conf loader="grub" cpu=1 memory=512M network0_type="virtio-net" network0_switch="public" disk0_type="virtio-blk" disk0_name="disk0.img" uuid="a68bdef0-cbc6-11e8-a293-d05099c11279" network0_mac="58:9c:fc:04:25:7a" Thanks -- Xavier HUMBERT From owner-freebsd-virtualization@freebsd.org Tue Oct 9 13:59:50 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 918A410CFACE for ; Tue, 9 Oct 2018 13:59:50 +0000 (UTC) (envelope-from matt.churchyard@userve.net) Received: from smtp-b.userve.net (smtp-outbound.userve.net [217.196.1.22]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.userve.net", Issuer "Thawte RSA CA 2018" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 30E908A31B for ; Tue, 9 Oct 2018 13:59:50 +0000 (UTC) (envelope-from matt.churchyard@userve.net) Received: from owa.usd-group.com (owa.usd-group.com [217.196.1.2]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by smtp-b.userve.net (Postfix) with ESMTPS id 1A88DFBE; Tue, 9 Oct 2018 14:59:49 +0100 (BST) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=userve.net; s=201508; t=1539093589; bh=/DDmDzcLbgk/x6rm00586rDdQ093cCiVcZf7Vj0xous=; h=From:To:Subject:Date:References:In-Reply-To; b=ZK6AtQVBCiKU2+EqsU7D/ZiyyL4hhcD4YDthrMtpOIDG0FROKuI6TGCfUQGWJ5KoD KZoqNR7qp86G3v1j4JsDQ6j2Kzw6nvJAog0ZKsWfzIPK86+0Cs+vOLngFLjCex3CQT VbgZFFtD9iDSmeqXhp37sXy6YdIbJ/t7zqIVI8sA= Received: from SERVER.ad.usd-group.com (192.168.0.1) by SERVER.ad.usd-group.com (192.168.0.1) with Microsoft SMTP Server (TLS) id 15.0.847.32; Tue, 9 Oct 2018 14:59:48 +0100 Received: from SERVER.ad.usd-group.com ([fe80::b19d:892a:6fc7:1c9]) by SERVER.ad.usd-group.com ([fe80::b19d:892a:6fc7:1c9%12]) with mapi id 15.00.0847.030; Tue, 9 Oct 2018 14:59:48 +0100 From: Matt Churchyard To: Xavier Humbert , "freebsd-virtualization@freebsd.org" Subject: RE: Problem installing Ubuntu with vm_byhve Thread-Topic: Problem installing Ubuntu with vm_byhve Thread-Index: AQHUXYNkklXx9QEbMUuD/IisvhhvaKUVFh9AgACHeICAAUIegIAAFTVg Date: Tue, 9 Oct 2018 13:59:47 +0000 Message-ID: <5b095cf792e14e78b5ba8a4b3ca374f3@SERVER.ad.usd-group.com> References: <55fd7896-d17c-88a2-ee07-70d8da9ed5ef@xavierhumbert.net> <5781057012064b52bd477a381271e512@SERVER.ad.usd-group.com> <42348955-c095-01ca-ae07-69bf77be4c96@xavierhumbert.net> In-Reply-To: <42348955-c095-01ca-ae07-69bf77be4c96@xavierhumbert.net> Accept-Language: en-GB, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [192.168.0.10] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 09 Oct 2018 13:59:50 -0000 On 08/10/2018 20:28, Xavier Humbert wrote: > On 08/10/2018 11:28, Matt Churchyard wrote: >> # vm create -t ubuntu ubuntu-guest >=20 > Oops, forgot to select the template ! >=20 > Works much better :-) >=20 > Thanks >=20 >Well it now boots and install, but when I reboot, I drop into grub. >Managed it with this mantra : >grub> set root=3D(hd0,gpt2) >grub> set prefix=3D(hd0,gpt2)/boot/grub >grub>insmod normal >grub>normal >How can I fix autoboot ? Looks like it wants to boot of the second partition but vm-bhyve looks on p= artition 1 by default. Try adding the following config - grub_run_partition=3D"2"=20 - or - grub_run_partition=3D"gpt2" (not sure if just "2" will work or whether it n= eeds the full "gpt2") >The actual ubuntu.conf >loader=3D"grub" >cpu=3D1 >memory=3D512M >network0_type=3D"virtio-net" >network0_switch=3D"public" >disk0_type=3D"virtio-blk" >disk0_name=3D"disk0.img" >uuid=3D"a68bdef0-cbc6-11e8-a293-d05099c11279" >network0_mac=3D"58:9c:fc:04:25:7a" >Thanks -- Xavier HUMBERT _________________________________= ______________ freebsd-virtualization@freebsd.org mailing list https://lists.freebsd.org/m= ailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freebs= d.org" From owner-freebsd-virtualization@freebsd.org Tue Oct 9 15:01:21 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D37CA10AE174 for ; Tue, 9 Oct 2018 15:01:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 916368CEC6 for ; Tue, 9 Oct 2018 15:01:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 55F6A10AE167; Tue, 9 Oct 2018 15:01:21 +0000 (UTC) Delivered-To: virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 44CAD10AE164 for ; Tue, 9 Oct 2018 15:01:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 015BB8CEC0 for ; Tue, 9 Oct 2018 15:01:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 35D181452E for ; Tue, 9 Oct 2018 15:01:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w99F1Kd5043173 for ; Tue, 9 Oct 2018 15:01:20 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w99F1KWk043164 for virtualization@FreeBSD.org; Tue, 9 Oct 2018 15:01:20 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 232084] bhyve crashes with SIGSEGV under NetBSD guest and xhci Date: Tue, 09 Oct 2018 15:01:19 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 09 Oct 2018 15:01:22 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D232084 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |virtualization@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Tue Oct 9 15:14:26 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 501B110AEB3A for ; Tue, 9 Oct 2018 15:14:26 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) Received: from admin.sibptus.ru (admin.sibptus.ru [IPv6:2001:19f0:5001:21dc:5400:1ff:feaf:6afb]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id E31528DB02 for ; Tue, 9 Oct 2018 15:14:25 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) Received: from vas by admin.sibptus.ru with local (Exim 4.91 (FreeBSD)) (envelope-from ) id 1g9tiI-000OoN-BA; Tue, 09 Oct 2018 22:14:22 +0700 Date: Tue, 9 Oct 2018 22:14:22 +0700 From: Victor Sudakov To: Matt Churchyard Cc: Josias =?iso-8859-1?Q?L=2E_Gon=E7alves?= , "freebsd-virtualization@freebsd.org" Subject: Re: [vm-bhyve] Does anyone have a vm template for Linux Mint ? Message-ID: <20181009151422.GA94629@admin.sibptus.ru> References: <20181006141906.GA10597@admin.sibptus.ru> <20181008133604.GA77358@admin.sibptus.ru> <20181008143806.GA78665@admin.sibptus.ru> <20181008145233.GA78859@admin.sibptus.ru> <20181009021713.GA88207@admin.sibptus.ru> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-PGP-Key: http://www.dreamwidth.org/pubkey?user=victor_sudakov X-PGP-Fingerprint: 10E3 1171 1273 E007 C2E9 3532 0DA4 F259 9B5E C634 User-Agent: Mutt/1.10.1 (2018-07-13) Sender: Victor Sudakov X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 09 Oct 2018 15:14:26 -0000 Matt Churchyard wrote: > > I have successfully** installed Ubuntu 16.04 (via VNC) using the following template, which is just a basic UEFI config with virtio network/disk. > > uefi="yes" > graphics="yes" > xhci_mouse="yes" > cpu=2 > memory=2G > network0_type="virtio-net" > network0_switch="public" > disk0_type="virtio-blk" > disk0_name="disk0.img" This plain UEFI template worked for me too, for Linux Mint. Thank you. > > **I did have two fairly annoying issues getting 16.04 to work - > > 1) After installation it seemed to refuse to reboot without me > removing the install CD, which I obviously couldn't do. I ended up > powering off the system manually with "vm poweroff guest" Had this problem too, I sent "vm stop mint" from another xterm. > > 2) It then would not boot due to the fact that Ubuntu 16.04 puts the > bootloader in a non-default location, then uses efivars to tell UEFI > how to find it. Unfortunately the bhyve EFI firmware still does not > save efivars, so any specific boot options set by a guest are lost > on restart. Did not have this problem with Mint. > I had to escape to the EFI shell and manually choose the > EFI/ubuntu/grubx64.efi loader. See my post #11 on this forum post > for more details - > https://forums.freebsd.org/threads/how-to-install-a-ubuntu-guest-in-bhyve.66767/ Thank you again, I may need it one day. -- Victor Sudakov, VAS4-RIPE, VAS47-RIPN 2:5005/49@fidonet http://vas.tomsk.ru/ From owner-freebsd-virtualization@freebsd.org Wed Oct 10 01:27:51 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2FEC910C4706 for ; Wed, 10 Oct 2018 01:27:51 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) Received: from admin.sibptus.ru (admin.sibptus.ru [IPv6:2001:19f0:5001:21dc:5400:1ff:feaf:6afb]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id BCBD488FA9 for ; Wed, 10 Oct 2018 01:27:50 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) Received: from vas by admin.sibptus.ru with local (Exim 4.91 (FreeBSD)) (envelope-from ) id 1gA3Hw-0000d4-Hp; Wed, 10 Oct 2018 08:27:48 +0700 Date: Wed, 10 Oct 2018 08:27:48 +0700 From: Victor Sudakov To: Josias =?iso-8859-1?Q?L=2E_Gon=E7alves?= , freebsd-virtualization@freebsd.org Subject: Re: [vm-bhyve] Does anyone have a vm template for Linux Mint ? Message-ID: <20181010012748.GA2382@admin.sibptus.ru> References: <20181006141906.GA10597@admin.sibptus.ru> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: X-PGP-Key: http://www.dreamwidth.org/pubkey?user=victor_sudakov X-PGP-Fingerprint: 10E3 1171 1273 E007 C2E9 3532 0DA4 F259 9B5E C634 User-Agent: Mutt/1.10.1 (2018-07-13) Sender: Victor Sudakov X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 10 Oct 2018 01:27:51 -0000 Josias L. Gonçalves wrote: > My ubuntu is something like that: > > guest="linux" > uefi="csm" > cpu=1 > memory=2G > network0_type="virtio-net" > network0_switch="public" > disk0_type="virtio-blk" > disk0_name="disk0.img" > Dear Josias, If you have a success story with uefi="csm", please share more detail with us. Does uefi="csm" fork for anyone? Can you boot MS-DOS in bhyve, for example? -- Victor Sudakov, VAS4-RIPE, VAS47-RIPN 2:5005/49@fidonet http://vas.tomsk.ru/ From owner-freebsd-virtualization@freebsd.org Wed Oct 10 08:11:27 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id F28E810CC20F for ; Wed, 10 Oct 2018 08:11:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id AD77873C2F for ; Wed, 10 Oct 2018 08:11:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 7279510CC209; Wed, 10 Oct 2018 08:11:26 +0000 (UTC) Delivered-To: virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6168E10CC207 for ; Wed, 10 Oct 2018 08:11:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 2435073C2A for ; Wed, 10 Oct 2018 08:11:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 723C31D4F5 for ; Wed, 10 Oct 2018 08:11:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w9A8BPpa036907 for ; Wed, 10 Oct 2018 08:11:25 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w9A8BPo7036903 for virtualization@FreeBSD.org; Wed, 10 Oct 2018 08:11:25 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 231430] 'Fatal trap 9: general protection fault while in kernel mode' when rebooting after installkernel on VirtualBox VM Date: Wed, 10 Oct 2018 08:11:24 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: yasu@utahime.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 10 Oct 2018 08:11:27 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D231430 Yasuhiro KIMURA changed: What |Removed |Added ---------------------------------------------------------------------------- Status|New |Closed Resolution|--- |FIXED --- Comment #8 from Yasuhiro KIMURA --- (In reply to Yasuhiro KIMURA from comment #7) While updating from ALPHA8 to ALPHA9 reboot succeeded without crash again. = So I conclude the problem is fixed and close this bug report. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Thu Oct 11 18:27:49 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6ADF710C3466 for ; Thu, 11 Oct 2018 18:27:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 0723E7BE65 for ; Thu, 11 Oct 2018 18:27:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id C070810C3464; Thu, 11 Oct 2018 18:27:48 +0000 (UTC) Delivered-To: virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id AF37B10C345F for ; Thu, 11 Oct 2018 18:27:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BE1C7BE5E for ; Thu, 11 Oct 2018 18:27:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 3BF287806 for ; Thu, 11 Oct 2018 18:27:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w9BIRlXU059059 for ; Thu, 11 Oct 2018 18:27:47 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w9BIRlF9059058 for virtualization@FreeBSD.org; Thu, 11 Oct 2018 18:27:47 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 230773] [bhyve] GDT limit needs reset on VMX exit Date: Thu, 11 Oct 2018 18:27:46 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: commit-hook@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 11 Oct 2018 18:27:49 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D230773 --- Comment #3 from commit-hook@freebsd.org --- A commit references this bug: Author: jhb Date: Thu Oct 11 18:27:20 UTC 2018 New revision: 339312 URL: https://svnweb.freebsd.org/changeset/base/339312 Log: Fully restore the GDTR, IDTR, and LDTR after VT-x VM exits. The VT-x VMCS only stores the base address of the GDTR and IDTR. As a result, VM exits use a fixed limit of 0xffff for the host GDTR and IDTR losing the smaller limits set in when the initial GDT is loaded on each CPU during boot. Explicitly save and restore the full GDTR and IDTR contents around VM entries and exits to restore the correct limit. Similarly, explicitly save and restore the LDT selector. VM exits always clear the host LDTR as if the LDT was loaded with a NULL selector and a userspace hypervisor is probably using a NULL selector anyway, but save and restore the LDT explicitly just to be safe. PR: 230773 Reported by: John Levon Reviewed by: kib Tested by: araujo Approved by: re (rgrimes) MFC after: 1 week Changes: head/sys/amd64/include/cpufunc.h head/sys/amd64/vmm/intel/vmx.c --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Thu Oct 11 18:28:55 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 03B8510C350A for ; Thu, 11 Oct 2018 18:28:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 92AF97BF29 for ; Thu, 11 Oct 2018 18:28:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 57DCB10C3509; Thu, 11 Oct 2018 18:28:54 +0000 (UTC) Delivered-To: virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4687510C3508 for ; Thu, 11 Oct 2018 18:28:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id D8CEC7BF22 for ; Thu, 11 Oct 2018 18:28:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 43577780D for ; Thu, 11 Oct 2018 18:28:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w9BISrr2060227 for ; Thu, 11 Oct 2018 18:28:53 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w9BISr3B060226 for virtualization@FreeBSD.org; Thu, 11 Oct 2018 18:28:53 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 230773] [bhyve] GDT limit needs reset on VMX exit Date: Thu, 11 Oct 2018 18:28:52 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: jhb@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: mfc-stable10? mfc-stable11? X-Bugzilla-Changed-Fields: bug_status flagtypes.name Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 11 Oct 2018 18:28:55 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D230773 John Baldwin changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Open |In Progress Flags| |mfc-stable10?, | |mfc-stable11? --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Thu Oct 11 19:02:55 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 928F610C459E for ; Thu, 11 Oct 2018 19:02:55 +0000 (UTC) (envelope-from jhb@FreeBSD.org) Received: from mail.baldwin.cx (bigwig.baldwin.cx [IPv6:2001:470:1f11:75::1]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 416207D57A for ; Thu, 11 Oct 2018 19:02:55 +0000 (UTC) (envelope-from jhb@FreeBSD.org) Received: from John-Baldwins-MacBook-Pro-2.local (ralph.baldwin.cx [66.234.199.215]) by mail.baldwin.cx (Postfix) with ESMTPSA id 592C010AFCD for ; Thu, 11 Oct 2018 15:02:53 -0400 (EDT) To: freebsd-virtualization@freebsd.org From: John Baldwin Subject: CFT: Reload LDTR after #VMEXIT on AMD-v in bhyve Message-ID: Date: Thu, 11 Oct 2018 12:02:51 -0700 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:52.0) Gecko/20100101 Thunderbird/52.9.1 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 8bit X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.4.3 (mail.baldwin.cx); Thu, 11 Oct 2018 15:02:54 -0400 (EDT) X-Virus-Scanned: clamav-milter 0.99.2 at mail.baldwin.cx X-Virus-Status: Clean X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 11 Oct 2018 19:02:55 -0000 Can someone using bhyve on an AMD host test this patch? Just booting a guest to multiuser is probably sufficient testing: https://github.com/bsdjhb/freebsd/commit/97323364e196900548f5293ac97bfb22b8a2ba72.patch Thanks. -- John Baldwin                                                                              From owner-freebsd-virtualization@freebsd.org Thu Oct 11 20:40:18 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C1B2610C6C99 for ; Thu, 11 Oct 2018 20:40:18 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost2.sentex.ca (smarthost2.sentex.ca [IPv6:2607:f3e0:80:80::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "smarthost2.sentex.ca", Issuer "Let's Encrypt Authority X3" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 6523780E32; Thu, 11 Oct 2018 20:40:18 +0000 (UTC) (envelope-from mike@sentex.net) Received: from lava.sentex.ca (lava.sentex.ca [IPv6:2607:f3e0:0:5:0:0:0:11]) by smarthost2.sentex.ca (8.15.2/8.15.2) with ESMTPS id w9BKeGmR002377 (version=TLSv1 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Thu, 11 Oct 2018 16:40:16 -0400 (EDT) (envelope-from mike@sentex.net) Received: from [192.168.43.26] (saphire3.sentex.net [192.168.43.26]) by lava.sentex.ca (8.15.2/8.15.2) with ESMTP id w9BKeE6Q019936; Thu, 11 Oct 2018 16:40:14 -0400 (EDT) (envelope-from mike@sentex.net) Subject: Re: CFT: Reload LDTR after #VMEXIT on AMD-v in bhyve To: John Baldwin , freebsd-virtualization@freebsd.org References: From: Mike Tancsa Openpgp: preference=signencrypt Autocrypt: addr=mike@sentex.net; prefer-encrypt=mutual; keydata= xsBNBEzcA24BCACpwI/iqOrs0GfQSfhA1v6Z8AcXVeGsRyKEKUpxoOYxXWc2z3vndbYlIP6E YJeifzKhS/9E+VjhhICaepLHfw865TDTUPr5D0Ed+edSsKjlnDtb6hfNJC00P7eoiuvi85TW F/gAxRY269A5d856bYrzLbkWp2lKUR3Bg6NnORtflGzx9ZWAltZbjYjjRqegPv0EQNYcHqWo eRpXilEo1ahT6nmOU8V7yEvT2j4wlLcQ6qg7w+N/vcBvyd/weiwHU+vTQ9mT61x5/wUrQhdw 2gJHeQXeDGMJV49RT2EEz+QVxaf477eyWsdQzPVjAKRMT3BVdK8WvpYAEfBAbXmkboOxABEB AAHNHG1pa2UgdGFuY3NhIDxtaWtlQHNlbnRleC5jYT7CwHgEEwECACIFAkzcA24CGwMGCwkI BwMCBhUIAgkKCwQWAgMBAh4BAheAAAoJEJXHwM2kc8rX+sMH/2V6pTBKsQ5mpWWLgs6wVP2k BC+6r/YKNXv9Rw/PrC6+9hTbgA+sSjJ+8gxsCbJsOQXZrxF0x3l9oYdYfuKcwdwXFX1/FS8p HfBeDkmlH+dI709xT9wgrR4dS5aMmKp0scPrXPIAKiYVOHjOlNItcLYTEEWEFBepheEVsgmk GrNbcrHwOx/u4igUQ8vcpyXPyUki+BsftPw8ZQvBU887igh0OxaCR8AurJppQ5UQd63r81cX E1ZjoFoWCaGK/SjPb/OhpYpu5swoZIhOxQbn7OtakYPsDd5t2A5KhvjI8BMTnd5Go+2xsCmr jlIEq8Bi29gCcfQUvNiClevi13ifmnnOwE0ETNwDbgEIALWGNJHRAhpd0A4vtd3G0oRqMBcM FGThQr3qORmEBTPPEomTdBaHcn+Xl+3YUvTBD/67/mutWBwgp2R5gQOSqcM7axvgMSHbKqBL 9sd1LsLw0UT2O5AYxv3EwzhG84pwRg3XcUqvWA4lA8tIj/1q4Jzi5qOkg1zxq4W9qr9oiYK5 bBR638JUvr3eHMaz/Nz+sDVFgwHmXZj3M6aE5Ce9reCGbvrae7H5D5PPvtT3r22X8SqfVAiO TFKedCf/6jbSOedPN931FJQYopj9P6b3m0nI3ZiCDVSqeyOAIBLzm+RBUIU3brzoxDhYR8pz CJc2sK8l6YjqivPakrD86bFDff8AEQEAAcLAXwQYAQIACQUCTNwDbgIbDAAKCRCVx8DNpHPK 1+iQB/99aqNtez9ZTBWELj269La8ntuRx6gCpzfPXfn6SDIfTItDxTh1hrdRVP5QNGGF5wus N4EMwXouskva1hbFX3Pv72csYSxxEJXjW16oV8WK4KjKXoskLg2RyRP4uXqL7Mp2ezNtVY5F 9nu3fj4ydpHCSaqKy5xd70A8D50PfZsFgkrsa5gdQhPiGGEdxhq/XSeAAnZ4uVLJKarH+mj5 MEhgZPEBWkGrbDZpezl9qbFcUem/uT9x8FYT/JIztMVh9qDcdP5tzANW5J7nvgXjska+VFGY ryZK4SPDczh74mn6GI/+RBi7OUzXXPgpPBrhS5FByjwCqjjsSpTjTds+NGIY Organization: Sentex Communications Message-ID: Date: Thu, 11 Oct 2018 16:40:15 -0400 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:52.0) Gecko/20100101 Thunderbird/52.9.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit Content-Language: en-US X-Scanned-By: MIMEDefang 2.83 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 11 Oct 2018 20:40:19 -0000 On 10/11/2018 3:02 PM, John Baldwin wrote: > Can someone using bhyve on an AMD host test this patch? Just booting a > guest to multiuser is probably sufficient testing: > > https://github.com/bsdjhb/freebsd/commit/97323364e196900548f5293ac97bfb22b8a2ba72.patch > > Thanks. > well, if I let the box boot fully and then load the vmm.ko, all is good. But if I load it from /boot/loader.conf, I get a panic at boot up (img attached) But other than that, it works fine. 0{ryzenbsd12}# fetch -o p https://github.com/bsdjhb/freebsd/commit/97323364e196900548f5293ac97bfb22b8a2ba72.patch fetch: https://github.com/bsdjhb/freebsd/commit/97323364e196900548f5293ac97bfb22b8a2ba72.patch: size of remote file is not known p                                                     1618  B   15 MBps    00s 0{ryzenbsd12}# patch < p Hmm...  Looks like a unified diff to me... The text leading up to this was: -------------------------- |From 97323364e196900548f5293ac97bfb22b8a2ba72 Mon Sep 17 00:00:00 2001 |From: John Baldwin |Date: Tue, 9 Oct 2018 14:49:37 -0700 |Subject: [PATCH] Reload the LDT selector after an AMD-v #VMEXIT. | |cpu_switch() always reloads the LDT, so this can only affect the |hypervisor process itself.  Fix this by explicitly reloading the host |LDT selector after each #VMEXIT.  The stock bhyve process on FreeBSD |never uses a custom LDT, so this change is cosmetic. |--- | sys/amd64/vmm/amd/svm.c | 13 +++++++++++++ | 1 file changed, 13 insertions(+) | |diff --git a/sys/amd64/vmm/amd/svm.c b/sys/amd64/vmm/amd/svm.c |index 2597bf9775706..c420db550bc7e 100644 |--- a/sys/amd64/vmm/amd/svm.c |+++ b/sys/amd64/vmm/amd/svm.c -------------------------- Patching file sys/amd64/vmm/amd/svm.c using Plan A... Hunk #1 succeeded at 1940. Hunk #2 succeeded at 2025. Hunk #3 succeeded at 2064. done 0{ryzenbsd12}# I confirmed prior to the patch I could run stock 11.2R  i386 and amd64 guest images on 12.0-ALPHA9 FreeBSD 12.0-ALPHA9 r339287 as the hypervisor CPU: AMD Ryzen 5 1600X Six-Core Processor            (3593.34-MHz K8-class CPU)   Origin="AuthenticAMD"  Id=0x800f11  Family=0x17  Model=0x1  Stepping=1   Features=0x178bfbff   Features2=0x7ed8320b   AMD Features=0x2e500800   AMD Features2=0x35c233ff   Structured Extended Features=0x209c01a9   XSAVE Features=0xf   AMD Extended Feature Extensions ID EBX=0x1007   SVM: NP,NRIP,VClean,AFlush,DAssist,NAsids=32768   TSC: P-state invariant, performance statistics with the patched version ivhd0: on acpi0 ivhd0: Flag:b0 ivhd0: Features(type:0x11) MsiNumPPR = 0 PNBanks= 2 PNCounters= 0 ivhd0: Extended features[31:0]:22294ada HATS = 0x2 GATS = 0x0 GLXSup = 0x1 SmiFSup = 0x1 SmiFRC = 0x2 GAMSup = 0x1 DualPortLogSup = 0x2 DualEventLogSup = 0x2 ivhd0: Extended features[62:32]:f77ef Max PASID: 0x2f DevTblSegSup = 0x3 MarcSup = 0x1 ivhd0: supported paging level:7, will use only: 4 ivhd0: device range: 0x0 - 0xffff ivhd0: PCI cap 0x190b640f@0x40 feature:19 Tested with ./vmrun.sh -c 4 -m 4096M -t tap0 -d FreeBSD-11.2-RELEASE-amd64.raw amd64 and ./vmrun.sh -c 4 -m 4096M -t tap1 -d FreeBSD-11.2-RELEASE-i386.raw i386 I sent a jpg of the crash in a separate image as it was rejected from the mailing list. ---Mike -- ------------------- Mike Tancsa, tel +1 519 651 3400 x203 Sentex Communications, mike@sentex.net Providing Internet services since 1994 www.sentex.net Cambridge, Ontario Canada From owner-freebsd-virtualization@freebsd.org Fri Oct 12 13:03:00 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9BAB610BD125 for ; Fri, 12 Oct 2018 13:03:00 +0000 (UTC) (envelope-from yuripv@yuripv.net) Received: from out3-smtp.messagingengine.com (out3-smtp.messagingengine.com [66.111.4.27]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 3993B81AEC for ; Fri, 12 Oct 2018 13:03:00 +0000 (UTC) (envelope-from yuripv@yuripv.net) Received: from compute5.internal (compute5.nyi.internal [10.202.2.45]) by mailout.nyi.internal (Postfix) with ESMTP id 4986820D93 for ; Fri, 12 Oct 2018 09:02:59 -0400 (EDT) Received: from mailfrontend2 ([10.202.2.163]) by compute5.internal (MEProxy); Fri, 12 Oct 2018 09:02:59 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yuripv.net; h=to :from:subject:message-id:date:mime-version:content-type; s=fm3; bh=MCsJuk/re/DbJ2Keu/RWzaj/2FB1n3ySU4sk1gaPcpA=; b=M+VNLRPHDO4r KnZUHPQP7gpMF2S0wFRML/jQMDGpyUFziJIwkFz1zy2pvLbVbkOGzz3+3mzWTYYq Kv7cJz06mEBxtvBUOiHYbqDl4SGXdpfSaehh1xnGnUz31Y2Em0/Kg4N/k5l7lL0a sWjdptQDzP/kSZm8BSxZ8YPNU7fBsBehdlregT0GoQqrGzlS5k+7vAvUBl5jfY4q 2L7Y9kjMevsQcZS8YZv2FT38E5TNzlz9I4Hrniie2QZMRZVPDWrDC45nB5hjt6gj PS6YVPxaI/rnSWbAvjW+i7Ph4R86WCer+fWGCfgikhOGlfPmAqiR38c10kPGFZeR bjik7TFbLg== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-type:date:from:message-id :mime-version:subject:to:x-me-proxy:x-me-proxy:x-me-sender :x-me-sender:x-sasl-enc; s=fm1; bh=MCsJuk/re/DbJ2Keu/RWzaj/2FB1n 3ySU4sk1gaPcpA=; b=FmXt22YB7Mp/dX+yVUm+fj03UTigdHXXrtXIFxI4Ep+fA WWuv7ti6ZTXYcz61gSEQ19U2B4RZD12acRxfS2Ym951J82AWpISJXORmIKOvhx2v /LShVFkxFzp75rpnOnJFz9aCLzgCncJHS/nFExDcRL0w82kOTw3G8mpTJFh7kWO/ uyAI+xA+L6BzEvUPlGhOCq1NQwps2HoLi1qh+4viYy2xDL1ufuYUB+XkNpBSXqC6 QITlhPAG6XSYJGGM+kyGODja/HDdgyrRC+Sf+oly1lBdw2fy4bE0vFzjf9vDGJvI KCByK/Kox6wGDUn2yT2VvPVXAPKXGd4vJzDG5B8Kg== X-ME-Sender: X-ME-Proxy: Received: from [192.168.1.2] (unknown [94.233.225.150]) by mail.messagingengine.com (Postfix) with ESMTPA id 324AA102D7 for ; Fri, 12 Oct 2018 09:02:57 -0400 (EDT) To: freebsd-virtualization From: Yuri Pankov Subject: bhyve VM using BHYVE_UEFI.fd gets EPT violation Openpgp: preference=signencrypt Autocrypt: addr=yuripv@yuripv.net; keydata= xsBNBFu8u6IBCADB11gP0QwnorrHjqAtKLHKHNHskhy0s7jqJKfx0YqXgVBKGLJ9/mjLAz0F CBNvemHSDDTs0mEZ9cBKKi6cmsav6+UQgr//yai6hvXLBJqKchSFO4MhmdvBtsGFq1yKz5Zi uhjmimKyIpgBgvMdbgGbGq6cnSB2uEPmZuJr419SVRODOkXukU+F5WHgaHzDdHAIu1asCt2B +6msxqIqlFWcXyZyTGicTGGvC/PFIsVRUtD1dIJANTC876g7DTb7LZXWiWwJpSJ4GKMXMHVX Ct9BoQ4i3nhKbOxb6Io1wsy+NFyWsTJ9KYrxKKPJP3oG8BWb/cqlFqnE4eNSsiq2q7krABEB AAHNH1l1cmkgUGFua292IDx5dXJpcHZAeXVyaXB2Lm5ldD7CwJcEEwEIAEECGwMFCQWjmoAF CwkIBwMFFQoJCAsFFgMCAQACHgECF4AWIQT4arc+w94tPi0v/3CTi+B/sSrhbAUCW708wAIZ AQAKCRCTi+B/sSrhbPxBB/961alcU091O+yKT5/oReHVc/PX0Tz4sW3V44AcgLfYlrZavCro EFz90qmCrl0xqEwuAKcC4bjmL8SjPWAhSN6IH9nxdw+HeZnAPiHm/q679Bu47+nHBl3qD/9p +t1PkKeKZfaWToFMt1nq06ytSu6VLMCwLdlDNe6DReX0ex/afEqKsuaIZSKL4UYjRwklp8PU Uf98QkrfapyHB67hQMzfI4tPeJaYyv0cTgfq3kUWJx1V6Xi0b6Zxj4ZrB2TXvaMO5g7yhU9E E3WWAvoe4FgB3a7dHe8atnHhq5+Cuvm6+LD4Jh7jvMAE5UMN+xxQpnGpNghHjaCy4vXrLRBZ nhRYzsBNBFu8u6IBCADKih3Q933rDNj4ZA8FhBQ2RlmBgvwOLcDPIL3h0V7h38y3+HisgFSc XACDsdrTlYZ1bRXkD9FHENynBcv0l/3uGJDk8jaGIDE0TP8OQBRp+IaU9/BHnAqrKxTJGIol Dahy2m+yx2yhdc6B4ujWMDqCF1rWOD+ymOWw+VLllOkrHcZa5PJtX9UOGbApZl8ZTM8El4CA NN8F1bg9MWzUi+8LYoGWGc+BwsFS1OUB1c4SPgMu5fD4Wfsr9yRl06fdpEA2YT7B/j5/5RSC 0sE2Zs/tmJ/JRflHJ12ycj59ma2xQMfEJF40hZDpMFQmZvbVqgEg3ocQcltjbxlIKZ/mjC4z ABEBAAHCwHwEGAEKACYWIQT4arc+w94tPi0v/3CTi+B/sSrhbAUCW7y7ogIbDAUJBaOagAAK CRCTi+B/sSrhbIDcCACqAZMcoxUBLZa40a5b24j5i1jplvCYYb3h+Q5lt5+BFJ87kCb4dJuU D3kh2i29BrxWQWa9WNue9ozxeYkbkfXubQYXexVolRsnh64OdGsE8KvorBFBB3zdK/GRt2Jy +jsnTfUWuQllbzMP0MfhCDMk1Mo8WvDH2/cOEP/yLKf20a+cd6nLs7bidjmGXo9pyuBKAtV6 Kv+VRu54AL+A/UBYu/eB3Dtvzcnut+1Zq6KaP++kUwPwINLIk04OBDwN0zRNTiqMAFYYyz2v ZHBB6E1th/l//ZC5b9Dk0ZpFI1bYdL9ymnrZe1MqbGPnDCToQxu00T/pZCm6Z92YrZQYuNwl Message-ID: <733a71ba-fc28-1aed-a0be-16e676e18159@yuripv.net> Date: Fri, 12 Oct 2018 16:02:45 +0300 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:60.0) Gecko/20100101 Thunderbird/60.2.1 MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="83hJCI9csgeDcJ6mq4TLLZvD2XYbaaxSu" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 12 Oct 2018 13:03:00 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --83hJCI9csgeDcJ6mq4TLLZvD2XYbaaxSu Content-Type: multipart/mixed; boundary="R1JJ7YeE9W6ptJz2L9VvRavkIUU8ugmwz"; protected-headers="v1" From: Yuri Pankov To: freebsd-virtualization Message-ID: <733a71ba-fc28-1aed-a0be-16e676e18159@yuripv.net> Subject: bhyve VM using BHYVE_UEFI.fd gets EPT violation --R1JJ7YeE9W6ptJz2L9VvRavkIUU8ugmwz Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: quoted-printable Hi, I'm taking my first steps in using bhyve, and the first showstopper seems to be that using '-l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd' gets me immediate vm exit with exit_reason being 48 (EPT violation). Relevant part of dmesg: FreeBSD 12.0-ALPHA9 r339291 GENERIC amd64 FreeBSD clang version 6.0.1 (tags/RELEASE_601/final 335540) (based on LLVM 6.0.1) WARNING: WITNESS option enabled, expect reduced performance. VT(efifb): resolution 800x600 CPU: Intel(R) Xeon(R) CPU E5-2660 v2 @ 2.20GHz (2200.04-MHz K8-class CPU)= Origin=3D"GenuineIntel" Id=3D0x306e4 Family=3D0x6 Model=3D0x3e Step= ping=3D4 Features=3D0xbfebfbff Features2=3D0x7fbee3ff AMD Features=3D0x2c100800 AMD Features2=3D0x1 Structured Extended Features=3D0x281 XSAVE Features=3D0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory =3D 274877906944 (262144 MB) avail memory =3D 267769249792 (255364 MB) Simplified invocation line (I tried with a lot more options initially, but this seems to get the same): # bhyve -c 2 -m 2G -l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd test vm exit[0] reason VMX rip 0x000000000000fff0 inst_length 3 status 0 exit_reason 48 (EPT violation) qualification 0x0000000000000184 inst_type 0 inst_error 0 Abort trap # bhyve -c 2 -m 2G -l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI_CSM.fd test vm exit[0] reason VMX rip 0x000000000000fff0 inst_length 3 status 0 exit_reason 48 (EPT violation) qualification 0x0000000000000184 inst_type 0 inst_error 0 Abort trap Any hints? --R1JJ7YeE9W6ptJz2L9VvRavkIUU8ugmwz-- --83hJCI9csgeDcJ6mq4TLLZvD2XYbaaxSu Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- iQEzBAEBCAAdFiEE+Gq3PsPeLT4tL/9wk4vgf7Eq4WwFAlvAm3UACgkQk4vgf7Eq 4WytNwf/XbAKldbwCclDUCSb/iSzkMovhMsYCPTvWVW6EEV6n4/EPuYGt32ZKTXJ 7bb4j7c1YSNYpJ5fmNwXbSFC6ZXjY7POdJi8Yuk7T0wp1NTw41CtgmpnEVkEDghH /Be+6bIgysuWdLQbIh5vBG4fENGnyBV1zm+2c0cKQFzSwWq9BK20mlFVawmiCKLx JU8Fqn+meFmj2DLS/goVlvf6xoZ3AOdaQBQRpmTu5Al/lcU707Io5HO67gRIEzdB qhkiaAnhBduuwah6KeSaBklGp83oPuNNwucWSDAUY2PdXR4mYHyR2MHVGVKDd1yu dMVSLjUJ6+sZYsiaECqou8ZeM1wBGw== =ow+d -----END PGP SIGNATURE----- --83hJCI9csgeDcJ6mq4TLLZvD2XYbaaxSu-- From owner-freebsd-virtualization@freebsd.org Fri Oct 12 13:44:00 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A7C4710BE7D4 for ; Fri, 12 Oct 2018 13:44:00 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost2.sentex.ca (smarthost2.sentex.ca [IPv6:2607:f3e0:80:80::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "smarthost2.sentex.ca", Issuer "Let's Encrypt Authority X3" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F10D833B5 for ; Fri, 12 Oct 2018 13:44:00 +0000 (UTC) (envelope-from mike@sentex.net) Received: from lava.sentex.ca (lava.sentex.ca [IPv6:2607:f3e0:0:5:0:0:0:11]) by smarthost2.sentex.ca (8.15.2/8.15.2) with ESMTPS id w9CDhxv1097098 (version=TLSv1 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO) for ; Fri, 12 Oct 2018 09:43:59 -0400 (EDT) (envelope-from mike@sentex.net) Received: from [192.168.43.26] (saphire3.sentex.net [192.168.43.26]) by lava.sentex.ca (8.15.2/8.15.2) with ESMTP id w9CDhvLJ023552; Fri, 12 Oct 2018 09:43:57 -0400 (EDT) (envelope-from mike@sentex.net) Subject: Re: CFT: Reload LDTR after #VMEXIT on AMD-v in bhyve To: Anish , "freebsd-virtualization@freebsd.org" References: From: Mike Tancsa Openpgp: preference=signencrypt Autocrypt: addr=mike@sentex.net; prefer-encrypt=mutual; keydata= xsBNBEzcA24BCACpwI/iqOrs0GfQSfhA1v6Z8AcXVeGsRyKEKUpxoOYxXWc2z3vndbYlIP6E YJeifzKhS/9E+VjhhICaepLHfw865TDTUPr5D0Ed+edSsKjlnDtb6hfNJC00P7eoiuvi85TW F/gAxRY269A5d856bYrzLbkWp2lKUR3Bg6NnORtflGzx9ZWAltZbjYjjRqegPv0EQNYcHqWo eRpXilEo1ahT6nmOU8V7yEvT2j4wlLcQ6qg7w+N/vcBvyd/weiwHU+vTQ9mT61x5/wUrQhdw 2gJHeQXeDGMJV49RT2EEz+QVxaf477eyWsdQzPVjAKRMT3BVdK8WvpYAEfBAbXmkboOxABEB AAHNHG1pa2UgdGFuY3NhIDxtaWtlQHNlbnRleC5jYT7CwHgEEwECACIFAkzcA24CGwMGCwkI BwMCBhUIAgkKCwQWAgMBAh4BAheAAAoJEJXHwM2kc8rX+sMH/2V6pTBKsQ5mpWWLgs6wVP2k BC+6r/YKNXv9Rw/PrC6+9hTbgA+sSjJ+8gxsCbJsOQXZrxF0x3l9oYdYfuKcwdwXFX1/FS8p HfBeDkmlH+dI709xT9wgrR4dS5aMmKp0scPrXPIAKiYVOHjOlNItcLYTEEWEFBepheEVsgmk GrNbcrHwOx/u4igUQ8vcpyXPyUki+BsftPw8ZQvBU887igh0OxaCR8AurJppQ5UQd63r81cX E1ZjoFoWCaGK/SjPb/OhpYpu5swoZIhOxQbn7OtakYPsDd5t2A5KhvjI8BMTnd5Go+2xsCmr jlIEq8Bi29gCcfQUvNiClevi13ifmnnOwE0ETNwDbgEIALWGNJHRAhpd0A4vtd3G0oRqMBcM FGThQr3qORmEBTPPEomTdBaHcn+Xl+3YUvTBD/67/mutWBwgp2R5gQOSqcM7axvgMSHbKqBL 9sd1LsLw0UT2O5AYxv3EwzhG84pwRg3XcUqvWA4lA8tIj/1q4Jzi5qOkg1zxq4W9qr9oiYK5 bBR638JUvr3eHMaz/Nz+sDVFgwHmXZj3M6aE5Ce9reCGbvrae7H5D5PPvtT3r22X8SqfVAiO TFKedCf/6jbSOedPN931FJQYopj9P6b3m0nI3ZiCDVSqeyOAIBLzm+RBUIU3brzoxDhYR8pz CJc2sK8l6YjqivPakrD86bFDff8AEQEAAcLAXwQYAQIACQUCTNwDbgIbDAAKCRCVx8DNpHPK 1+iQB/99aqNtez9ZTBWELj269La8ntuRx6gCpzfPXfn6SDIfTItDxTh1hrdRVP5QNGGF5wus N4EMwXouskva1hbFX3Pv72csYSxxEJXjW16oV8WK4KjKXoskLg2RyRP4uXqL7Mp2ezNtVY5F 9nu3fj4ydpHCSaqKy5xd70A8D50PfZsFgkrsa5gdQhPiGGEdxhq/XSeAAnZ4uVLJKarH+mj5 MEhgZPEBWkGrbDZpezl9qbFcUem/uT9x8FYT/JIztMVh9qDcdP5tzANW5J7nvgXjska+VFGY ryZK4SPDczh74mn6GI/+RBi7OUzXXPgpPBrhS5FByjwCqjjsSpTjTds+NGIY Organization: Sentex Communications Message-ID: <9b364843-4e41-e927-9221-a0109d37c36c@sentex.net> Date: Fri, 12 Oct 2018 09:43:58 -0400 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:52.0) Gecko/20100101 Thunderbird/52.9.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit Content-Language: en-US X-Scanned-By: MIMEDefang 2.83 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 12 Oct 2018 13:44:01 -0000 On 10/11/2018 11:21 PM, Anish wrote: > Can you share the panic image? > I got serial hooked up to it now.  I am not sure if this really is vmm related or it happens to be hitting some other bug Loading kernel... /boot/kernel/kernel text=0x16b5750 data=0x1cd888+0x76c930 syms=[0x8+0x17deb8+0x8+0x19aa72] Loading configured modules... /boot/kernel/aesni.ko size 0xc7e0 at 0x2653000 /boot/kernel/pf.ko size 0x566b8 at 0x2660000 /boot/kernel/zfs.ko size 0x3a9858 at 0x26b7000 loading required module 'opensolaris' /boot/kernel/opensolaris.ko size 0xa4f0 at 0x2a61000 /boot/kernel/if_cxgbe.ko size 0xc5c18 at 0x2a6c000 /boot/kernel/t5fw_cfg.ko size 0xad740 at 0x2b32000 /boot/kernel/vmm.ko size 0x56f458 at 0x2be0000 /boot/kernel/ums.ko size 0x6130 at 0x3150000 /boot/kernel/amdtemp.ko size 0x3ef8 at 0x3157000 loading required module 'amdsmn' /boot/kernel/amdsmn.ko size 0x21d0 at 0x315b000 /boot/entropy size=0x1000 GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb ---<>--- Copyright (c) 1992-2018 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994         The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 12.0-ALPHA9 r339328 GENERIC-NODEBUG amd64 FreeBSD clang version 6.0.1 (tags/RELEASE_601/final 335540) (based on LLVM 6.0.1) VT(vga): resolution 640x480 CPU: AMD Ryzen 5 1600X Six-Core Processor            (3593.34-MHz K8-class CPU)   Origin="AuthenticAMD"  Id=0x800f11  Family=0x17  Model=0x1  Stepping=1   Features=0x178bfbff   Features2=0x7ed8320b   AMD Features=0x2e500800   AMD Features2=0x35c233ff   Structured Extended Features=0x209c01a9   XSAVE Features=0xf   AMD Extended Feature Extensions ID EBX=0x1007   SVM: NP,NRIP,VClean,AFlush,DAssist,NAsids=32768   TSC: P-state invariant, performance statistics real memory  = 34359738368 (32768 MB) avail memory = 33288642560 (31746 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 1 package(s) x 2 cache groups x 3 core(s) x 2 hardware threads random: unblocking device. Firmware Warning (ACPI): Optional FADT field Pm2ControlBlock has valid Length but zero Address: 0x0000000000000000/0x1 (20181003/tbfadt-796) ioapic0 irqs 0-23 on motherboard ioapic1 irqs 24-55 on motherboard Launching APs: 10 7 9 3 1 5 8 2 4 6 11 Timecounter "TSC-low" frequency 1796671728 Hz quality 1000 random: entropy device external interface module_register_init: MOD_LOAD (vesa, 0xffffffff8112af50, 0) error 19 random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" kbd1 at kbdmux0 netmap: loaded module [ath_hal] loaded nexus0 vtvga0: on motherboard aesni0: on motherboard cryptosoft0: on motherboard acpi0: on motherboard acpi0: Power Button (fixed) AMD-Vi: IVRS Info VAsize = 64 PAsize = 48 GVAsize = 2 flags:0 cpu0: on acpi0 attimer0: port 0x40-0x43 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 atrtc0: port 0x70-0x71 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 hpet0: iomem 0xfed00000-0xfed003ff irq 0,8 on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 350 Event timer "HPET2" frequency 14318180 Hz quality 350 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <32-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 amdsmn0: on hostb0 amdtemp0: on hostb0 pci0: at device 0.2 (no driver attached) pcib1: at device 1.3 on pci0 pci1: on pcib1 xhci0: mem 0xf6fa0000-0xf6fa7fff irq 32 at device 0.0 on pci1 xhci0: 32 bytes context size, 64-bit DMA usbus0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 ahci0: mem 0xf6f80000-0xf6f9ffff irq 33 at device 0.1 on pci1 ahci0: AHCI v1.31 with 8 6Gbps ports, Port Multiplier supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahcich4: at channel 4 on ahci0 ahcich5: at channel 5 on ahci0 ahcich6: at channel 6 on ahci0 ahcich7: at channel 7 on ahci0 pcib2: irq 34 at device 0.2 on pci1 pci2: on pcib2 pcib3: irq 32 at device 0.0 on pci2 pci3: on pcib3 pcib4: irq 34 at device 2.0 on pci2 pci4: on pcib4 pcib5: irq 35 at device 3.0 on pci2 pci5: on pcib5 pcib6: irq 32 at device 4.0 on pci2 pci6: on pcib6 xhci1: mem 0xf6e00000-0xf6e07fff irq 32 at device 0.0 on pci6 xhci1: 32 bytes context size, 64-bit DMA usbus1 on xhci1 usbus1: 5.0Gbps Super Speed USB v3.0 pcib7: irq 34 at device 6.0 on pci2 pci7: on pcib7 igb0: port 0xe000-0xe01f mem 0xf6d00000-0xf6d1ffff,0xf6d20000-0xf6d23fff irq 34 at device 0.0 on pci7 igb0: attach_pre capping queues at 2 igb0: using 1024 tx descriptors and 1024 rx descriptors igb0: msix_init qsets capped at 2 igb0: pxm cpus: 6 queue msgs: 4 admincnt: 1 igb0: using 2 rx queues 2 tx queues igb0: Using MSIX interrupts with 3 vectors igb0: allocated for 2 tx_queues igb0: allocated for 2 rx_queues igb0: Ethernet address: 60:45:cb:a0:8a:84 igb0: netmap queues/slots: TX 2/1024, RX 2/1024 pcib8: irq 35 at device 7.0 on pci2 pci8: on pcib8 pcib9: at device 3.1 on pci0 pci9: on pcib9 t5nex0: mem 0xf6300000-0xf637ffff,0xf5000000-0xf5ffffff,0xf6884000-0xf6885fff irq 54 at device 0.4 on pci9 t5nex0: Disabled No Snoop/Relaxed Ordering on pcib9 cxl0: on t5nex0 cxl0: Ethernet address: 00:07:43:2a:88:f0 cxl0: 12 txq, 8 rxq (NIC); 8 txq (TOE), 2 rxq (TOE) cxl1: on t5nex0 cxl1: Ethernet address: 00:07:43:2a:88:f8 cxl1: 12 txq, 8 rxq (NIC); 8 txq (TOE), 2 rxq (TOE) t5nex0: PCIe gen3 x8, 2 ports, 22 MSI-X interrupts, 62 eq, 21 iq pci9: at device 0.5 (no driver attached) pci9: at device 0.6 (no driver attached) pcib10: at device 3.2 on pci0 pci10: on pcib10 vgapci0: mem 0xf3000000-0xf3ffffff,0xc0000000-0xdfffffff,0xf2000000-0xf2ffffff irq 50 at device 0.0 on pci10 vgapci0: Boot video device pcib11: at device 7.1 on pci0 pci11: on pcib11 pci11: at device 0.0 (no driver attached) pci11: at device 0.2 (no driver attached) xhci2: mem 0xf6a00000-0xf6afffff irq 37 at device 0.3 on pci11 xhci2: 64 bytes context size, 64-bit DMA usbus2 on xhci2 usbus2: 5.0Gbps Super Speed USB v3.0 pcib12: at device 8.1 on pci0 pci12: on pcib12 pci12: at device 0.0 (no driver attached) ahci1: mem 0xf7008000-0xf7008fff irq 42 at device 0.2 on pci12 ahci1: AHCI v1.31 with 1 6Gbps ports, Port Multiplier supported with FBS ahcich8: at channel 0 on ahci1 hdac0: mem 0xf7000000-0xf7007fff irq 43 at device 0.3 on pci12 isab0: at device 20.3 on pci0 isa0: on isab0 acpi_button0: on acpi0 uart2: <16x50 with 256 byte FIFO> iomem 0xfedc9000-0xfedc9fff,0xfedc7000-0xfedc7fff irq 3 on acpi0 uart3: <16x50 with 256 byte FIFO> iomem 0xfedca000-0xfedcafff,0xfedc8000-0xfedc8fff irq 4 on acpi0 uart4: <16x50 with 256 byte FIFO> iomem 0xfedce000-0xfedcefff,0xfedcc000-0xfedccfff irq 3 on acpi0 uart5: <16x50 with 256 byte FIFO> iomem 0xfedcf000-0xfedcffff,0xfedcd000-0xfedcdfff irq 4 on acpi0 atkbdc0: port 0x60,0x64 irq 1 on acpi0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart0: console (115200,n,8,1) ivhd0: on acpi0 ivhd0: Flag:b0 ivhd0: Features(type:0x11) MsiNumPPR = 0 PNBanks= 2 PNCounters= 0 ivhd0: Extended features[31:0]:22294ada HATS = 0x2 GATS = 0x0 GLXSup = 0x1 SmiFSup = 0x1 SmiFRC = 0x2 GAMSup = 0x1 DualPortLogSup = 0x2 DualEventLogSup = 0x2 ivhd0: Extended features[62:32]:f77ef Max PASID: 0x2f DevTblSegSup = 0x3 MarcSup = 0x1 ivhd0: supported paging level:7, will use only: 4 ivhd0: device range: 0x0 - 0xffff ivhd0: PCI cap 0x190b640f@0x40 feature:19 orm0: at iomem 0xce800-0xcf7ff,0xcf800-0xd07ff,0xd0800-0xd17ff pnpid ORM0000 on isa0 hwpstate0: on cpu0 ZFS filesystem version: 5 ZFS storage pool version: features support (5000) Timecounters tick every 1.000 msec hdacc0: at cad 0 on hdac0 hdaa0: at nid 1 on hdacc0 pcm0: at nid 20,22,21 and 24,26 on hdaa0 pcm1: at nid 27 and 25 on hdaa0 pcm2: at nid 30 on hdaa0 ugen2.1: <0x1022 XHCI root HUB> at usbus2 ugen0.1: <0x1022 XHCI root HUB> at usbus0 ugen1.1: <0x1b21 XHCI root HUB> at usbus1 uhub0: <0x1022 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus2 uhub1: <0x1022 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0 ada0 at ahcich0 bus 0 scbus0 target 0 lun 0 ada0: ACS-4 ATA SATA 3.x device ada0: Serial Number 173895428875 ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 512bytes) ada0: Command Queueing enabled ada0: 476940MB (976773168 512 byte sectors) uhub2: ada1 at ahcich1 bus 0 scbus1 target 0 lun 0 ada1: ACS-4 ATA SATA 3.x device ada1: Serial Number 173895420726 ada1: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 512bytes) ada1: Command Queueing enabled ada1: 476940MB (976773168 512 byte sectors) <0x1b21 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus1 ada2 at ahcich2 bus 0 scbus2 target 0 lun 0 ada2: ATA8-ACS SATA 2.x device ada2: Serial Number WD-WMATV6277272 ada2: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) ada2: Command Queueing enabled ada2: 953869MB (1953525168 512 byte sectors) ada3 at ahcich3 bus 0 scbus3 target 0 lun 0 ada3: ATA8-ACS SATA 2.x device ada3: Serial Number WD-WMATV4158030 ada3: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) ada3: Command Queueing enabled ada3: 953869MB (1953525168 512 byte sectors) Trying to mount root from zfs:zroot/ROOT/default []... Root mount waiting for: usbus2 usbus1 usbus0 uhub2: 4 ports with 4 removable, self powered uhub0: 8 ports with 8 removable, self powered uhub1: 22 ports with 22 removable, self powered Fatal trap 12: page fault while in kernel mode cpuid = 0; apic id = 00 fault virtual address   = 0x398 fault code              = supervisor write data, page not present instruction pointer     = 0x20:0xffffffff8273d776 stack pointer           = 0x28:0xfffffe0075d55230 frame pointer           = 0x28:0xfffffe0075d55270 code segment            = base 0x0, limit 0xfffff, type 0x1b                         = DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags        = interrupt enabled, resume, IOPL = 0 current process         = 1 (kernel) [ thread pid 1 tid 100002 ] Stopped at      rrw_enter_read_impl+0x36:       lock cmpxchgq   %r14,0x18(%rbx) db> bt Tracing pid 1 tid 100002 td 0xfffff8000567d580 rrw_enter_read_impl() at rrw_enter_read_impl+0x36/frame 0xfffffe0075d55270 zfs_mount() at zfs_mount+0x7b2/frame 0xfffffe0075d55400 vfs_domount() at vfs_domount+0x5b2/frame 0xfffffe0075d55630 vfs_donmount() at vfs_donmount+0x930/frame 0xfffffe0075d556d0 kernel_mount() at kernel_mount+0x3d/frame 0xfffffe0075d55720 parse_mount() at parse_mount+0x451/frame 0xfffffe0075d55860 vfs_mountroot() at vfs_mountroot+0x7a0/frame 0xfffffe0075d559f0 start_init() at start_init+0x27/frame 0xfffffe0075d55a70 fork_exit() at fork_exit+0x83/frame 0xfffffe0075d55ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0075d55ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db> > > > well, if I let the box boot fully and then load the vmm.ko, all is > good. > But if I load it from /boot/loader.conf, I get a panic at boot up (img > attached) > > But other than that, it works fine. > > > 0{ryzenbsd12}# fetch -o p > https://github.com/bsdjhb/freebsd/commit/97323364e196900548f5293ac97bfb22b8a2ba72.patch > fetch: > https://github.com/bsdjhb/freebsd/commit/97323364e196900548f5293ac97bfb22b8a2ba72.patch: > size of remote file is not known > p                                                     1618  B   15 > MBps    00s > 0{ryzenbsd12}# patch < p > Hmm...  Looks like a unified diff to me... > The text leading up to this was: > -------------------------- > |From 97323364e196900548f5293ac97bfb22b8a2ba72 Mon Sep 17 00:00:00 > 2001 > |From: John Baldwin > |Date: Tue, 9 Oct 2018 14:49:37 -0700 > |Subject: [PATCH] Reload the LDT selector after an AMD-v #VMEXIT. > | > |cpu_switch() always reloads the LDT, so this can only affect the > |hypervisor process itself.  Fix this by explicitly reloading the host > |LDT selector after each #VMEXIT.  The stock bhyve process on FreeBSD > |never uses a custom LDT, so this change is cosmetic. > |--- > | sys/amd64/vmm/amd/svm.c | 13 +++++++++++++ > | 1 file changed, 13 insertions(+) > | > |diff --git a/sys/amd64/vmm/amd/svm.c b/sys/amd64/vmm/amd/svm.c > |index 2597bf9775706..c420db550bc7e 100644 > |--- a/sys/amd64/vmm/amd/svm.c > |+++ b/sys/amd64/vmm/amd/svm.c > -------------------------- > Patching file sys/amd64/vmm/amd/svm.c using Plan A... > Hunk #1 succeeded at 1940. > Hunk #2 succeeded at 2025. > Hunk #3 succeeded at 2064. > done > 0{ryzenbsd12}# > > I confirmed prior to the patch I could run stock 11.2R  i386 and amd64 > guest images on 12.0-ALPHA9 FreeBSD 12.0-ALPHA9 r339287 as the > hypervisor > > CPU: AMD Ryzen 5 1600X Six-Core Processor            (3593.34-MHz > K8-class CPU) >   Origin="AuthenticAMD"  Id=0x800f11  Family=0x17  Model=0x1  > Stepping=1 >   > Features=0x178bfbff >   > Features2=0x7ed8320b >   AMD Features=0x2e500800 >   AMD > Features2=0x35c233ff >   Structured Extended > Features=0x209c01a9 >   XSAVE Features=0xf >   AMD Extended Feature Extensions ID > EBX=0x1007 >   SVM: NP,NRIP,VClean,AFlush,DAssist,NAsids=32768 >   TSC: P-state invariant, performance statistics > > > > > with the patched version > > ivhd0: on acpi0 > ivhd0: Flag:b0 > ivhd0: Features(type:0x11) MsiNumPPR = 0 PNBanks= 2 PNCounters= 0 > ivhd0: Extended features[31:0]:22294ada > HATS = > 0x2 GATS = 0x0 GLXSup = 0x1 SmiFSup = 0x1 SmiFRC = 0x2 GAMSup = 0x1 > DualPortLogSup = 0x2 DualEventLogSup = 0x2 > ivhd0: Extended features[62:32]:f77ef Max PASID: 0x2f > DevTblSegSup = 0x3 MarcSup = 0x1 > ivhd0: supported paging level:7, will use only: 4 > ivhd0: device range: 0x0 - 0xffff > ivhd0: PCI cap 0x190b640f@0x40 feature:19 > > > Tested with > > ./vmrun.sh -c 4 -m 4096M -t tap0 -d FreeBSD-11.2-RELEASE-amd64.raw > amd64 > and > ./vmrun.sh -c 4 -m 4096M -t tap1 -d FreeBSD-11.2-RELEASE-i386.raw i386 > > > I sent a jpg of the crash in a separate image as it was rejected > from the mailing list. > >         ---Mike > > -- > ------------------- > Mike Tancsa, tel +1 519 651 3400 x203 > Sentex Communications, mike@sentex.net > Providing Internet services since 1994 www.sentex.net > > Cambridge, Ontario Canada    > > _______________________________________________ > freebsd-virtualization@freebsd.org > mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to > "freebsd-virtualization-unsubscribe@freebsd.org > " > -- ------------------- Mike Tancsa, tel +1 519 651 3400 x203 Sentex Communications, mike@sentex.net Providing Internet services since 1994 www.sentex.net Cambridge, Ontario Canada From owner-freebsd-virtualization@freebsd.org Fri Oct 12 13:54:06 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9EAFC10BEE94 for ; Fri, 12 Oct 2018 13:54:06 +0000 (UTC) (envelope-from matt.churchyard@userve.net) Received: from smtp-a.userve.net (smtp-outbound.userve.net [217.196.1.22]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.userve.net", Issuer "Thawte RSA CA 2018" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 148CE83B76 for ; Fri, 12 Oct 2018 13:54:05 +0000 (UTC) (envelope-from matt.churchyard@userve.net) Received: from owa.usd-group.com (owa.usd-group.com [217.196.1.2]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by smtp-a.userve.net (Postfix) with ESMTPS id 8C324257; Fri, 12 Oct 2018 14:53:57 +0100 (BST) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=userve.net; s=201508; t=1539352437; bh=VUlT/LzR3bXwlTcHF8gjYIjugLPtDWOPvqS5O+NuUP8=; h=From:To:Subject:Date:References:In-Reply-To; b=YoLS8W8MOkJFTxzu38VpeXAB0SZKr3qVTMzB3KafC9hCoUWZXYbAjGYZTEMKMpGqH 1j9CYG3+1rPvc+LbgQPf3+N+eDoirFRfyJVR8YGboMFDhngWjxfv3J8rwz2rpoaXl2 YDPmfoK4D8ePLFA9AMc3Gl1GGC0zN0L/+Zow3Jbg= Received: from SERVER.ad.usd-group.com (192.168.0.1) by SERVER.ad.usd-group.com (192.168.0.1) with Microsoft SMTP Server (TLS) id 15.0.847.32; Fri, 12 Oct 2018 14:53:57 +0100 Received: from SERVER.ad.usd-group.com ([fe80::b19d:892a:6fc7:1c9]) by SERVER.ad.usd-group.com ([fe80::b19d:892a:6fc7:1c9%12]) with mapi id 15.00.0847.030; Fri, 12 Oct 2018 14:53:57 +0100 From: Matt Churchyard To: Yuri Pankov , freebsd-virtualization Subject: RE: bhyve VM using BHYVE_UEFI.fd gets EPT violation Thread-Topic: bhyve VM using BHYVE_UEFI.fd gets EPT violation Thread-Index: AQHUYiv4tnGw4XOtsU+kbFIasewKH6Ubn+pA Date: Fri, 12 Oct 2018 13:53:56 +0000 Message-ID: References: <733a71ba-fc28-1aed-a0be-16e676e18159@yuripv.net> In-Reply-To: <733a71ba-fc28-1aed-a0be-16e676e18159@yuripv.net> Accept-Language: en-GB, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [192.168.0.10] Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 12 Oct 2018 13:54:06 -0000 PkhpLA0KDQo+SSdtIHRha2luZyBteSBmaXJzdCBzdGVwcyBpbiB1c2luZyBiaHl2ZSwgYW5kIHRo ZSBmaXJzdCBzaG93c3RvcHBlciBzZWVtcyB0byBiZSB0aGF0IHVzaW5nICctbCBib290cm9tLC91 c3IvbG9jYWwvc2hhcmUvdWVmaS1maXJtd2FyZS9CSFlWRV9VRUZJLmZkJyBnZXRzIG1lIGltbWVk aWF0ZSB2bSBleGl0IHdpdGggPmV4aXRfcmVhc29uIGJlaW5nIDQ4IChFUFQgdmlvbGF0aW9uKS4N Cg0KPlJlbGV2YW50IHBhcnQgb2YgZG1lc2c6DQoNCkZyZWVCU0QgMTIuMC1BTFBIQTkgcjMzOTI5 MSBHRU5FUklDIGFtZDY0IEZyZWVCU0QgY2xhbmcgdmVyc2lvbiA2LjAuMSAodGFncy9SRUxFQVNF XzYwMS9maW5hbCAzMzU1NDApIChiYXNlZCBvbiBMTFZNIDYuMC4xKQ0KV0FSTklORzogV0lUTkVT UyBvcHRpb24gZW5hYmxlZCwgZXhwZWN0IHJlZHVjZWQgcGVyZm9ybWFuY2UuDQpWVChlZmlmYik6 IHJlc29sdXRpb24gODAweDYwMA0KQ1BVOiBJbnRlbChSKSBYZW9uKFIpIENQVSBFNS0yNjYwIHYy IEAgMi4yMEdIeiAoMjIwMC4wNC1NSHogSzgtY2xhc3MgQ1BVKQ0KICBPcmlnaW49IkdlbnVpbmVJ bnRlbCIgIElkPTB4MzA2ZTQgIEZhbWlseT0weDYgIE1vZGVsPTB4M2UgIFN0ZXBwaW5nPTQNCg0K RmVhdHVyZXM9MHhiZmViZmJmZjxGUFUsVk1FLERFLFBTRSxUU0MsTVNSLFBBRSxNQ0UsQ1g4LEFQ SUMsU0VQLE1UUlIsUEdFLE1DQSxDTU9WLFBBVCxQU0UzNixDTEZMVVNILERUUyxBQ1BJLE1NWCxG WFNSLFNTRSxTU0UyLFNTLEhUVCxUTSxQQkU+DQoNCkZlYXR1cmVzMj0weDdmYmVlM2ZmPFNTRTMs UENMTVVMUURRLERURVM2NCxNT04sRFNfQ1BMLFZNWCxTTVgsRVNULFRNMixTU1NFMyxDWDE2LHhU UFIsUERDTSxQQ0lELERDQSxTU0U0LjEsU1NFNC4yLHgyQVBJQyxQT1BDTlQsVFNDRExULEFFU05J LFhTQVZFLE9TWFNBVkUsQVZYLEYxNkMsUkRSQU5EPg0KICBBTUQgRmVhdHVyZXM9MHgyYzEwMDgw MDxTWVNDQUxMLE5YLFBhZ2UxR0IsUkRUU0NQLExNPg0KICBBTUQgRmVhdHVyZXMyPTB4MTxMQUhG Pg0KICBTdHJ1Y3R1cmVkIEV4dGVuZGVkIEZlYXR1cmVzPTB4MjgxPEZTR1NCQVNFLFNNRVAsRVJN Uz4NCiAgWFNBVkUgRmVhdHVyZXM9MHgxPFhTQVZFT1BUPg0KICBWVC14OiBQQVQsSExULE1URixQ QVVTRSxFUFQsVUcsVlBJRCxWSUQsUG9zdEludHINCiAgVFNDOiBQLXN0YXRlIGludmFyaWFudCwg cGVyZm9ybWFuY2Ugc3RhdGlzdGljcyByZWFsIG1lbW9yeSAgPSAyNzQ4Nzc5MDY5NDQgKDI2MjE0 NCBNQikgYXZhaWwgbWVtb3J5ID0gMjY3NzY5MjQ5NzkyICgyNTUzNjQgTUIpDQoNClNpbXBsaWZp ZWQgaW52b2NhdGlvbiBsaW5lIChJIHRyaWVkIHdpdGggYSBsb3QgbW9yZSBvcHRpb25zIGluaXRp YWxseSwgYnV0IHRoaXMgc2VlbXMgdG8gZ2V0IHRoZSBzYW1lKToNCg0KIyBiaHl2ZSAtYyAyIC1t IDJHIC1sDQpib290cm9tLC91c3IvbG9jYWwvc2hhcmUvdWVmaS1maXJtd2FyZS9CSFlWRV9VRUZJ LmZkIHRlc3Qgdm0gZXhpdFswXQ0KICAgICAgICByZWFzb24gICAgICAgICAgVk1YDQogICAgICAg IHJpcCAgICAgICAgICAgICAweDAwMDAwMDAwMDAwMGZmZjANCiAgICAgICAgaW5zdF9sZW5ndGgg ICAgIDMNCiAgICAgICAgc3RhdHVzICAgICAgICAgIDANCiAgICAgICAgZXhpdF9yZWFzb24gICAg IDQ4IChFUFQgdmlvbGF0aW9uKQ0KICAgICAgICBxdWFsaWZpY2F0aW9uICAgMHgwMDAwMDAwMDAw MDAwMTg0DQogICAgICAgIGluc3RfdHlwZSAgICAgICAgICAgICAgIDANCiAgICAgICAgaW5zdF9l cnJvciAgICAgICAgICAgICAgMA0KQWJvcnQgdHJhcA0KDQojIGJoeXZlIC1jIDIgLW0gMkcgLWwN CmJvb3Ryb20sL3Vzci9sb2NhbC9zaGFyZS91ZWZpLWZpcm13YXJlL0JIWVZFX1VFRklfQ1NNLmZk IHRlc3Qgdm0gZXhpdFswXQ0KICAgICAgICByZWFzb24gICAgICAgICAgVk1YDQogICAgICAgIHJp cCAgICAgICAgICAgICAweDAwMDAwMDAwMDAwMGZmZjANCiAgICAgICAgaW5zdF9sZW5ndGggICAg IDMNCiAgICAgICAgc3RhdHVzICAgICAgICAgIDANCiAgICAgICAgZXhpdF9yZWFzb24gICAgIDQ4 IChFUFQgdmlvbGF0aW9uKQ0KICAgICAgICBxdWFsaWZpY2F0aW9uICAgMHgwMDAwMDAwMDAwMDAw MTg0DQogICAgICAgIGluc3RfdHlwZSAgICAgICAgICAgICAgIDANCiAgICAgICAgaW5zdF9lcnJv ciAgICAgICAgICAgICAgMA0KQWJvcnQgdHJhcA0KDQo+IEFueSBoaW50cz8NCg0KVGhlIGNvbW1h bmRzIHlvdSdyZSBydW5uaW5nIGFyZW4ndCByZWFsbHkgdmVyeSB1c2VmdWwgYXMgeW91IGhhdmVu J3QgcHJvdmlkZWQgYSBjb25zb2xlIGRldmljZSwgb3IgYW55IGRpc2svbmV0d29yay9ldGMuDQpI b3dldmVyIHRoZSBtYWluIGlzc3VlIGFwcGVhcnMgdG8gYmUgYSBsYWNrIG9mIGFuIGxwYyBkZXZp Y2UuIEkgZ2V0IHRoZSBleGFjdCBzYW1lIGVycm9yIG9uIGEgZnVsbHkgd29ya2luZyBzeXN0ZW0g aWYgSSByZW1vdmUgdGhhdCBkZXZpY2UuDQoNCk5vdGUgdGhlcmUgaXMgL3Vzci9zaGFyZS9leGFt cGxlcy9iaHl2ZS92bXJ1bi5zaCwgYW5kIHRvb2xzIGluIHBvcnRzIHRvIGhhbmRsZSBydW5uaW5n IGJoeXZlIGNvbW1hbmRzIGZvciB5b3UuIChVbmxlc3MgeW91IGFyZSBpbnRlbnRpb25hbGx5IHRy eWluZyB0byBsZWFybiB0aGUgcmF3IGJoeXZlIGNvbW1hbmQgc3ludGF4IG9mIGNvdXJzZSkNCg0K TWF0dA0KDQo= From owner-freebsd-virtualization@freebsd.org Fri Oct 12 14:22:26 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5F36A10BFD61 for ; Fri, 12 Oct 2018 14:22:26 +0000 (UTC) (envelope-from yuripv@yuripv.net) Received: from out3-smtp.messagingengine.com (out3-smtp.messagingengine.com [66.111.4.27]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id EFC5884B9B for ; Fri, 12 Oct 2018 14:22:25 +0000 (UTC) (envelope-from yuripv@yuripv.net) Received: from compute5.internal (compute5.nyi.internal [10.202.2.45]) by mailout.nyi.internal (Postfix) with ESMTP id 69608213FC; Fri, 12 Oct 2018 10:22:25 -0400 (EDT) Received: from mailfrontend2 ([10.202.2.163]) by compute5.internal (MEProxy); Fri, 12 Oct 2018 10:22:25 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yuripv.net; h= subject:to:references:from:message-id:date:mime-version :in-reply-to:content-type; s=fm3; bh=4ZLQvvg87+hqDpiqC1xWBL5opgW ujKcykjx0LvOqLRg=; b=yuqyIt//17h3JI8IeK0wVvVYAG2NUeTMzVNGGjiKgeJ xW3/eK5wIEgx79H8d+U3EYo3SgJrnaziKFfyQLm0Sc4P85dsBYk9V4cKsbaMbcpI EXybvEGSCBMJg+wqQHTRDRekyzrTxMSGar/ML6kHjv8YQ+dhJQ63zPscA5u4/9Fk cQPNc+y3yr7g5RWzkFPLlJ0eszPGR6digmh+SwUdn22hsS3YNhxTECS8zRBSvWFM lONg7l4txqRCS4LURf5gUlsXwcdAQSOkqzrFPKi+AGYO4vx+mPlPDiVzd7T0ZNPM 9ldD71P1qS7HLWwxy63xHuVVYTojUwBc48Mv6D+BMFQ== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to:x-me-proxy :x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm1; bh=4ZLQvv g87+hqDpiqC1xWBL5opgWujKcykjx0LvOqLRg=; b=WnJwj5kVvHnR53GXcTkkM9 ph7LSYfGWSY91OA7PRrUCkx2OlQmxddStN4y9H8XtHHHy7nf0txjBE8VhQMOK/KH 4U3IKk3qfqDhb9uan4ViVOLClB7UJ+Ic2lmKfN01tzq8Jc3mJV1Zr1Rbhdir45I5 n7o4J/XoUwbNpHAzH5CKIBmexwIUSJPQevRSiOHysUySkmyAI0u1wQD6K4XRdmsN Rl8GlT0otHB3DdJqT1I6AV18V8c6p8zjiSBjbHPzulCAhe2GHkOVTKET4k03Q98Z hFnsRVyjz+dsINIf1F03YkKZc1jkBCVrNdgFaDeT5sIyjAh90A1a79vWWXvzU75g == X-ME-Sender: X-ME-Proxy: Received: from [192.168.1.2] (unknown [94.233.225.150]) by mail.messagingengine.com (Postfix) with ESMTPA id 46BE5102EA; Fri, 12 Oct 2018 10:22:23 -0400 (EDT) Subject: Re: bhyve VM using BHYVE_UEFI.fd gets EPT violation To: Matt Churchyard , freebsd-virtualization References: <733a71ba-fc28-1aed-a0be-16e676e18159@yuripv.net> From: Yuri Pankov Openpgp: preference=signencrypt Autocrypt: addr=yuripv@yuripv.net; keydata= xsBNBFu8u6IBCADB11gP0QwnorrHjqAtKLHKHNHskhy0s7jqJKfx0YqXgVBKGLJ9/mjLAz0F CBNvemHSDDTs0mEZ9cBKKi6cmsav6+UQgr//yai6hvXLBJqKchSFO4MhmdvBtsGFq1yKz5Zi uhjmimKyIpgBgvMdbgGbGq6cnSB2uEPmZuJr419SVRODOkXukU+F5WHgaHzDdHAIu1asCt2B +6msxqIqlFWcXyZyTGicTGGvC/PFIsVRUtD1dIJANTC876g7DTb7LZXWiWwJpSJ4GKMXMHVX Ct9BoQ4i3nhKbOxb6Io1wsy+NFyWsTJ9KYrxKKPJP3oG8BWb/cqlFqnE4eNSsiq2q7krABEB AAHNH1l1cmkgUGFua292IDx5dXJpcHZAeXVyaXB2Lm5ldD7CwJcEEwEIAEECGwMFCQWjmoAF CwkIBwMFFQoJCAsFFgMCAQACHgECF4AWIQT4arc+w94tPi0v/3CTi+B/sSrhbAUCW708wAIZ AQAKCRCTi+B/sSrhbPxBB/961alcU091O+yKT5/oReHVc/PX0Tz4sW3V44AcgLfYlrZavCro EFz90qmCrl0xqEwuAKcC4bjmL8SjPWAhSN6IH9nxdw+HeZnAPiHm/q679Bu47+nHBl3qD/9p +t1PkKeKZfaWToFMt1nq06ytSu6VLMCwLdlDNe6DReX0ex/afEqKsuaIZSKL4UYjRwklp8PU Uf98QkrfapyHB67hQMzfI4tPeJaYyv0cTgfq3kUWJx1V6Xi0b6Zxj4ZrB2TXvaMO5g7yhU9E E3WWAvoe4FgB3a7dHe8atnHhq5+Cuvm6+LD4Jh7jvMAE5UMN+xxQpnGpNghHjaCy4vXrLRBZ nhRYzsBNBFu8u6IBCADKih3Q933rDNj4ZA8FhBQ2RlmBgvwOLcDPIL3h0V7h38y3+HisgFSc XACDsdrTlYZ1bRXkD9FHENynBcv0l/3uGJDk8jaGIDE0TP8OQBRp+IaU9/BHnAqrKxTJGIol Dahy2m+yx2yhdc6B4ujWMDqCF1rWOD+ymOWw+VLllOkrHcZa5PJtX9UOGbApZl8ZTM8El4CA NN8F1bg9MWzUi+8LYoGWGc+BwsFS1OUB1c4SPgMu5fD4Wfsr9yRl06fdpEA2YT7B/j5/5RSC 0sE2Zs/tmJ/JRflHJ12ycj59ma2xQMfEJF40hZDpMFQmZvbVqgEg3ocQcltjbxlIKZ/mjC4z ABEBAAHCwHwEGAEKACYWIQT4arc+w94tPi0v/3CTi+B/sSrhbAUCW7y7ogIbDAUJBaOagAAK CRCTi+B/sSrhbIDcCACqAZMcoxUBLZa40a5b24j5i1jplvCYYb3h+Q5lt5+BFJ87kCb4dJuU D3kh2i29BrxWQWa9WNue9ozxeYkbkfXubQYXexVolRsnh64OdGsE8KvorBFBB3zdK/GRt2Jy +jsnTfUWuQllbzMP0MfhCDMk1Mo8WvDH2/cOEP/yLKf20a+cd6nLs7bidjmGXo9pyuBKAtV6 Kv+VRu54AL+A/UBYu/eB3Dtvzcnut+1Zq6KaP++kUwPwINLIk04OBDwN0zRNTiqMAFYYyz2v ZHBB6E1th/l//ZC5b9Dk0ZpFI1bYdL9ymnrZe1MqbGPnDCToQxu00T/pZCm6Z92YrZQYuNwl Message-ID: <17e01512-4f67-b2ae-8f15-6ad393fe010f@yuripv.net> Date: Fri, 12 Oct 2018 17:22:12 +0300 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:60.0) Gecko/20100101 Thunderbird/60.2.1 MIME-Version: 1.0 In-Reply-To: Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="fdUCZmJbDZing43H0npF24tUQpPCgmvmW" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 12 Oct 2018 14:22:26 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --fdUCZmJbDZing43H0npF24tUQpPCgmvmW Content-Type: multipart/mixed; boundary="iO9DyWmJ5IckzKFcdRkB7hmWPGGUvaSKC"; protected-headers="v1" From: Yuri Pankov To: Matt Churchyard , freebsd-virtualization Message-ID: <17e01512-4f67-b2ae-8f15-6ad393fe010f@yuripv.net> Subject: Re: bhyve VM using BHYVE_UEFI.fd gets EPT violation References: <733a71ba-fc28-1aed-a0be-16e676e18159@yuripv.net> In-Reply-To: --iO9DyWmJ5IckzKFcdRkB7hmWPGGUvaSKC Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: quoted-printable Matt Churchyard wrote: >> Hi, >=20 >> I'm taking my first steps in using bhyve, and the first showstopper se= ems to be that using '-l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEF= I.fd' gets me immediate vm exit with >exit_reason being 48 (EPT violation= ). >=20 >> Relevant part of dmesg: >=20 > FreeBSD 12.0-ALPHA9 r339291 GENERIC amd64 FreeBSD clang version 6.0.1 (= tags/RELEASE_601/final 335540) (based on LLVM 6.0.1) > WARNING: WITNESS option enabled, expect reduced performance. > VT(efifb): resolution 800x600 > CPU: Intel(R) Xeon(R) CPU E5-2660 v2 @ 2.20GHz (2200.04-MHz K8-class CP= U) > Origin=3D"GenuineIntel" Id=3D0x306e4 Family=3D0x6 Model=3D0x3e St= epping=3D4 >=20 > Features=3D0xbfebfbff >=20 > Features2=3D0x7fbee3ff > AMD Features=3D0x2c100800 > AMD Features2=3D0x1 > Structured Extended Features=3D0x281 > XSAVE Features=3D0x1 > VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr > TSC: P-state invariant, performance statistics real memory =3D 27487= 7906944 (262144 MB) avail memory =3D 267769249792 (255364 MB) >=20 > Simplified invocation line (I tried with a lot more options initially, = but this seems to get the same): >=20 > # bhyve -c 2 -m 2G -l > bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd test vm exit[0] > reason VMX > rip 0x000000000000fff0 > inst_length 3 > status 0 > exit_reason 48 (EPT violation) > qualification 0x0000000000000184 > inst_type 0 > inst_error 0 > Abort trap >=20 > # bhyve -c 2 -m 2G -l > bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI_CSM.fd test vm exit[0= ] > reason VMX > rip 0x000000000000fff0 > inst_length 3 > status 0 > exit_reason 48 (EPT violation) > qualification 0x0000000000000184 > inst_type 0 > inst_error 0 > Abort trap >=20 >> Any hints? >=20 > The commands you're running aren't really very useful as you haven't pr= ovided a console device, or any disk/network/etc. Yes, I was just trimming down the initial command to produce a small test case, but... > However the main issue appears to be a lack of an lpc device. I get the= exact same error on a fully working system if I remove that device. Thank you! Indeed, adding '-s 31,lpc' solves this for me (it wasn't there initially when I had console, disk, network, etc. if the command line), somehow I missed its importance. > Note there is /usr/share/examples/bhyve/vmrun.sh, and tools in ports to= handle running bhyve commands for you. (Unless you are intentionally try= ing to learn the raw bhyve command syntax of course) I'm just checking if I can replace ESXi instance with bhyve, the reason being that I hope I'll be actually able to automate VM creation I need for testing purposes without learning ESXi tools (PowerShell?). --iO9DyWmJ5IckzKFcdRkB7hmWPGGUvaSKC-- --fdUCZmJbDZing43H0npF24tUQpPCgmvmW Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- iQEzBAEBCAAdFiEE+Gq3PsPeLT4tL/9wk4vgf7Eq4WwFAlvArhQACgkQk4vgf7Eq 4Wyjxwf/T2Cujy5U4oGnQwRHw7h9MBO/EJt+PDcmhjnZ8gct0ndofVnZL7kvRw6W gyeDVmQZMXYHDwkraUN114/veDObeoS2abXN2Fjj7S7DgRwUjfueoOHw/1VKju3r TP2wF1EopXeFmWj8+lBUxKiw9LGiMiglPKb0yJb9sR2kWBuyfp9ZhGuQxI6fjAOn YiMZtsFzHCzcb8T2cLLcOzzulWrmN54dkym9NeveJwDK4ubiNnnNc4mf47SPCoWt StCP6Wy+QFnmSfTZbqkmndabGlTPR6W6AT74RsI+VFmZzzaO12xNXL6DulHQ2Bx5 vi/rj6BlPQc4S5O3L7ZFcgxgoW95gw== =s4sm -----END PGP SIGNATURE----- --fdUCZmJbDZing43H0npF24tUQpPCgmvmW--