From owner-freebsd-virtualization@FreeBSD.ORG  Thu Oct 30 22:17:05 2014
Return-Path: <owner-freebsd-virtualization@FreeBSD.ORG>
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 514A5276
 for <freebsd-virtualization@freebsd.org>; Thu, 30 Oct 2014 22:17:05 +0000 (UTC)
Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12])
 by mx1.freebsd.org (Postfix) with ESMTP id 13620AC9
 for <freebsd-virtualization@freebsd.org>; Thu, 30 Oct 2014 22:17:04 +0000 (UTC)
Received: from dommail.onthenet.com.au (dommail.OntheNet.com.au [203.13.70.57])
 by alto.onthenet.com.au (Postfix) with ESMTP id 64CEE126E1;
 Fri, 31 Oct 2014 08:16:56 +1000 (EST)
Received: from Peter-Grehans-MacBook-Pro-2.local
 (c-67-161-27-37.hsd1.ca.comcast.net [67.161.27.37])
 by dommail.onthenet.com.au (MOS 4.4.4-GA)
 with ESMTP id BZI37077 (AUTH peterg@ptree32.com.au);
 Fri, 31 Oct 2014 08:16:54 +1000
Message-ID: <5452B8D4.4070204@freebsd.org>
Date: Thu, 30 Oct 2014 15:16:52 -0700
From: Peter Grehan <grehan@freebsd.org>
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6;
 rv:24.0) Gecko/20100101 Thunderbird/24.6.0
MIME-Version: 1.0
To: Andrea Brancatelli <abrancatelli@schema31.it>
Subject: Re: bhyve machine not starting after upgrading
References: <D136FCF3-2BAB-4F9D-B109-792F69BFB47A@schema31.it>
In-Reply-To: <D136FCF3-2BAB-4F9D-B109-792F69BFB47A@schema31.it>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit
Cc: freebsd-virtualization@freebsd.org
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 <freebsd-virtualization.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-virtualization>, 
 <mailto:freebsd-virtualization-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-virtualization/>
List-Post: <mailto:freebsd-virtualization@freebsd.org>
List-Help: <mailto:freebsd-virtualization-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization>, 
 <mailto:freebsd-virtualization-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Thu, 30 Oct 2014 22:17:05 -0000

Hi Andrea,

> I had some wonderfully working machines with bhyve with a plain
> 10.0-p4. I just upgraded to 10.1-RC3 and now the VMs won’t boot
> anymore: they get just stuck with "unable to load kernel”. After some
> trials and errors I think I traced it to user boot getting confused
> by a ZFS partition inside the VM.
>
> I did some experiments with set currdev and got the kernel loaded but
> then the machine just hangs.
>
> Please give me some advice :-)

  This was reported by Craig Rodrigues a while back - the email thread is at

 
http://docs.freebsd.org/cgi/mid.cgi?CAG=rPVd5OQ1Gw6q-e94Ffnk_zPxkFvjaR5bpOOjMg7j-9AvSdw

  I never got around to implementing the flag to disable ZFS boot, but 
you may be able to use an alternate workaround. From your manual fix:

OK set currdev=disk0p2:
OK set rootdev=disk0p2:

  Env variables can be set from the bhyveload command line using "-e 
<env>=<value>". Now, I'm not sure that currdev and rootdev can be set 
that early in the boot, but it's worth a try e.g. add these:

  -e currdev="disk0p2:" -e rootdev="disk0p2:"

later,

Peter.