From owner-freebsd-virtualization@freebsd.org  Tue Feb 27 18:52:32 2018
Return-Path: <owner-freebsd-virtualization@freebsd.org>
Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
 by mailman.ysv.freebsd.org (Postfix) with ESMTP id D1B2FF3F68D
 for <freebsd-virtualization@mailman.ysv.freebsd.org>;
 Tue, 27 Feb 2018 18:52:32 +0000 (UTC)
 (envelope-from julian@freebsd.org)
Received: from vps1.elischer.org (vps1.elischer.org [204.109.63.16])
 (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
 (Client CN "vps1.elischer.org",
 Issuer "CA Cert Signing Authority" (not verified))
 by mx1.freebsd.org (Postfix) with ESMTPS id 5E62468EAF;
 Tue, 27 Feb 2018 18:52:28 +0000 (UTC)
 (envelope-from julian@freebsd.org)
Received: from Julian-MBP3.local (203-59-173-201.dyn.iinet.net.au
 [203.59.173.201]) (authenticated bits=0)
 by vps1.elischer.org (8.15.2/8.15.2) with ESMTPSA id w1RIqFu1074762
 (version=TLSv1.2 cipher=DHE-RSA-AES128-SHA bits=128 verify=NO);
 Tue, 27 Feb 2018 10:52:19 -0800 (PST)
 (envelope-from julian@freebsd.org)
To: FreeBSD virtualization mailing list <freebsd-virtualization@FreeBSD.org>, 
 Peter Grehan <grehan@FreeBSD.org>
From: Julian Elischer <julian@freebsd.org>
Subject: bhyve bombed out..
Message-ID: <052690c9-1a8c-241e-d09c-f6feefd58638@freebsd.org>
Date: Wed, 28 Feb 2018 02:52:09 +0800
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.13; rv:52.0)
 Gecko/20100101 Thunderbird/52.6.0
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 8bit
Content-Language: en-US
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.25
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 <freebsd-virtualization.freebsd.org>
List-Unsubscribe: <https://lists.freebsd.org/mailman/options/freebsd-virtualization>, 
 <mailto:freebsd-virtualization-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-virtualization/>
List-Post: <mailto:freebsd-virtualization@freebsd.org>
List-Help: <mailto:freebsd-virtualization-request@freebsd.org?subject=help>
List-Subscribe: <https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization>, 
 <mailto:freebsd-virtualization-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Tue, 27 Feb 2018 18:52:33 -0000

environment:

HOST: freebsd 12 (a couple of weeks ago) on ESX 6.0.0

yes..  nested Virtualisation

Client:

slightly modified freebsd current (from the 20th)

Bhyve dies afer a while with:

vm exit[0]
     reason        VMX
     rip        0x00000008003e4b03
     inst_length    0
     status        0
     exit_reason    48
     qualification    0x0000000000000001
     inst_type        0
     inst_error        0
Abort trap
*** Error code 99

Any suggestions?

I'm working towards having a hardware host.

This doesn't work at all on esx 5.1.1 so I'm actually amazed it runs 
for as long as it does on 6.0.0... (days if not doing much).