From owner-freebsd-virtualization@freebsd.org Sat Nov 12 00:28:20 2016 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id CB284C3AA1D for ; Sat, 12 Nov 2016 00:28:20 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12]) by mx1.freebsd.org (Postfix) with ESMTP id 8E8B51391 for ; Sat, 12 Nov 2016 00:28:20 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from iredmail.onthenet.com.au (iredmail.onthenet.com.au [203.13.68.150]) by alto.onthenet.com.au (Postfix) with ESMTPS id E7BE520C1BEF for ; Sat, 12 Nov 2016 10:28:02 +1000 (AEST) Received: from localhost (iredmail.onthenet.com.au [127.0.0.1]) by iredmail.onthenet.com.au (Postfix) with ESMTP id DF4C5280900 for ; Sat, 12 Nov 2016 10:28:02 +1000 (AEST) X-Amavis-Modified: Mail body modified (using disclaimer) - iredmail.onthenet.com.au Received: from iredmail.onthenet.com.au ([127.0.0.1]) by localhost (iredmail.onthenet.com.au [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id OmNr-mgxWG9K for ; Sat, 12 Nov 2016 10:28:02 +1000 (AEST) Received: from busmail.onthenet.com.au (iredmail.onthenet.com.au [127.0.0.1]) by iredmail.onthenet.com.au (Postfix) with ESMTPSA id BB5E52808F7; Sat, 12 Nov 2016 10:28:02 +1000 (AEST) MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII; format=flowed Content-Transfer-Encoding: 7bit Date: Fri, 11 Nov 2016 16:28:02 -0800 From: grehan@freebsd.org To: Alex Deiter Cc: freebsd-virtualization@freebsd.org Subject: Re: [Bug 214432] bhyve VM exiting: reason VMX / =?UTF-8?Q?exit=5Freason=20=32?= In-Reply-To: <530F83B0-DC83-423C-9B3F-EB930FC27F3C@gmail.com> References: <530F83B0-DC83-423C-9B3F-EB930FC27F3C@gmail.com> Message-ID: <797f78046e400db482df45e13073b229@ptree32.com.au> X-Sender: grehan@freebsd.org User-Agent: OntheNet Business Mail X-CMAE-Score: 0 X-CMAE-Analysis: v=2.2 cv=DZ1nkrlW c=1 sm=1 tr=0 a=A6CF0fG5TOl4vs6YHvqXgw==:117 a=kj9zAlcOel0A:10 a=L24OOQBejmoA:10 a=6I5d2MoRAAAA:8 a=0uhv0JDTcEe-hY71f8IA:9 a=CjuIK1q_8ugA:10 a=rICxaf_bQtsA:10 a=IjZwj45LgO3ly-622nXo:22 wl=host:3 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 12 Nov 2016 00:28:20 -0000 Hi Alex, > I'm trying to start a SmartOS joyent_20161110T013148Z guest VM in > bhyve on FreeBSD/amd64 12.0-CURRENT(r308465). ... > # cat grub.cfg > multiboot /platform/i86pc/kernel/amd64/unix > /platform/i86pc/kernel/amd64/unix -B smartos=true,console=ttyb > module /platform/i86pc/amd64/boot_archive > /platform/i86pc/amd64/boot_archive type=rootfs name=ramdisk > boot The SmartOS kernel issues BIOS calls while running. You will need to boot it with a UEFI/CSM image that provides a BIOS interface - grub-bhyve only does image placement, so a BIOS call from a guest will eventually result in a triple-fault (exit code 2, from the Intel SDM Vol3 Appendix C. Yes, a bit cryptic, and should at least be a text message). Instructions for booting SmartOS are at: https://lists.freebsd.org/pipermail/freebsd-virtualization/2015-October/003833.html though, I'd add another line to that -s 0,hostbridge \ .. which allows recent SmartOS versions to use MSI interrupts for virtio devices. later, Peter.