From owner-freebsd-virtualization@freebsd.org Tue Mar 16 14:06:34 2021 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C2D1F5AECDD for ; Tue, 16 Mar 2021 14:06:34 +0000 (UTC) (envelope-from bsdlists@jld3.net) Received: from mail.jld3.net (mail.jld3.net [45.55.236.93]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4F0FT56WNfz4bZp for ; Tue, 16 Mar 2021 14:06:33 +0000 (UTC) (envelope-from bsdlists@jld3.net) Received: from localhost (localhost [127.0.0.1]) by mail.jld3.net (Postfix) with ESMTP id E51F1414DD for ; Tue, 16 Mar 2021 08:06:26 -0600 (MDT) X-Virus-Scanned: amavisd-new at jld3.net Received: from mail.jld3.net ([127.0.0.1]) by localhost (mail.jld3.net [127.0.0.1]) (amavisd-new, port 10024) with LMTP id ulcMFdZv3dwG for ; Tue, 16 Mar 2021 08:06:26 -0600 (MDT) Received: from [172.21.35.248] (c-24-9-144-115.hsd1.co.comcast.net [24.9.144.115]) (using TLSv1.2 with cipher AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) (Authenticated sender: jld) by mail.jld3.net (Postfix) with ESMTPSA id 785D44061E for ; Tue, 16 Mar 2021 08:06:25 -0600 (MDT) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.jld3.net 785D44061E DKIM-Filter: OpenDKIM Filter v2.11.0 mail.jld3.net 785D44061E From: "John Doherty" To: freebsd-virtualization@freebsd.org Subject: vm-bhyve No disk(s) present to configure Date: Tue, 16 Mar 2021 08:01:44 -0600 X-Mailer: MailMate (1.13.2r5673) Message-ID: <287B3102-DD04-40EE-8233-41E114E45B2F@jld3.net> MIME-Version: 1.0 Content-Type: text/plain; format=flowed X-Rspamd-Queue-Id: 4F0FT56WNfz4bZp X-Spamd-Bar: --- X-Spamd-Result: default: False [-4.00 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[45.55.236.93:from]; R_DKIM_ALLOW(-0.20)[jld3.net:s=8d052f02dde2]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[45.55.236.93:from:127.0.2.255]; RCVD_COUNT_THREE(0.00)[4]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; DKIM_TRACE(0.00)[jld3.net:+]; DMARC_POLICY_ALLOW(-0.50)[jld3.net,quarantine]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:14061, ipnet:45.55.192.0/18, country:US]; MID_RHS_MATCH_FROM(0.00)[]; MAILMAN_DEST(0.00)[freebsd-virtualization]; RECEIVED_SPAMHAUS_PBL(0.00)[24.9.144.115:received] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 16 Mar 2021 14:06:34 -0000 Hi, I am trying to get started with vm-bhyve and getting a little stuck. I am sure there are things I don't understand here so I hope you will bear with me. I am using a machine with an AMD FX-8370E eight-core CPU, running 12.2-RELEASE-p4. The machine boots from a ~60GB SATA SSD which is configured as the zroot zpool. I have run a few bhyve vms on this machine before, including a couple of linux variants, by just using the bhyve command directly and they worked fine. In those cases, I just used files created with truncate(1) for vm disks but I would like to use zvols. vm-bhyve looks pretty nice to me and I think I'd like using it also. I have this in /boot/loader.conf: vmm_load="YES" nmdm_load="YES" if_tap_load="YES" if_bridge_load="YES" and this in /etc/rc.conf: vm_enable="YES" vm_dir="zfs:zroot/vmm" vm_list="" vm_delay="5" And so I thus have this: [root@sand] # zfs list -r zroot/vmm NAME USED AVAIL REFER MOUNTPOINT zroot/vmm 1.43G 36.8G 1.43G /vmm and this: [root@sand] # vm datastore list NAME TYPE PATH ZFS DATASET default zfs /vmm zroot/vmm I have populated /vmm/.templates with the files from /usr/local/share/examples/vm-bhyve but made some changes to them. For example, the freebsd-zvol.conf template now looks like this: loader="bhyveload" cpu=1 memory=4096M network0_type="virtio-net" network0_switch="public" disk0_dev="sparse-zvol" disk0_name="disk0" I've also populated /vmm/.iso with some ISO images including FreeBSD-12.2-RELEASE-amd64-disc1.iso. So with that, I can for example do this: [root@sand] # vm create -t freebsd-zvol fbsd1 [root@sand] # vm list NAME DATASTORE LOADER CPU MEMORY VNC AUTOSTART STATE fbsd1 default bhyveload 1 4096M - No Stopped and zfs things then look like this: [root@sand] # zfs list -r zroot/vmm NAME USED AVAIL REFER MOUNTPOINT zroot/vmm 1.43G 36.8G 1.43G /vmm zroot/vmm/fbsd1 164K 36.8G 108K /vmm/fbsd1 zroot/vmm/fbsd1/disk0 56K 36.8G 56K - So that all seems pretty good so far. Then I do this: vm install -f fbsd1 FreeBSD-12.2-RELEASE-amd64-disc1.iso The vm boots and I'm asked to choose a console type, I take the default vt100, and boom -- I get the familiar FreeBSD Installer screen. I proceed through that and try to do a Guided Root-on-ZFS installation, but when I choose Pool Type/Disks, I'm told "No disk(s) present to configure." So. Pretty clearly doing something wrong here but I'm not sure what. Happy to provide any further info that I might have neglected above. Any advice that points me in the right direction much appreciated. Thanks.