From owner-freebsd-virtualization@freebsd.org Mon Jan 23 12:00:41 2017 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0237ACBC0E7 for ; Mon, 23 Jan 2017 12:00:41 +0000 (UTC) (envelope-from alexander.nusov@nfvexpress.com) Received: from sender163-mail.zoho.com (sender163-mail.zoho.com [74.201.84.163]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id E3D3D18E for ; Mon, 23 Jan 2017 12:00:40 +0000 (UTC) (envelope-from alexander.nusov@nfvexpress.com) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; t=1485172824; s=zoho; d=nfvexpress.com; i=alexander.nusov@nfvexpress.com; h=From:Content-Type:Mime-Version:Subject:Message-Id:Date:To; l=36722; bh=rqJ4Bl2UoiBPQ7Wumvci6B9EsdI8bmDI7l2c0YMsckw=; b=cMabBcDqCYAxEDDOEoAMXeR2KaclLTxAgy5AAbSIZl2X2cairMzpUo5SNuXqgyho sUNGI3DRf5SZ4DyG1yo/QZXfU0fCNePseWHmNVn20WnJS445P2+tOE2IH3n261oHRLc LV5EBsOZvdU0HjNhhX+wDlDXcjQ9DUcT+unUefWU= Received: from [192.168.1.66] (95-30-222-83.broadband.corbina.ru [95.30.222.83]) by mx.zohomail.com with SMTPS id 1485172823362426.39426821305426; Mon, 23 Jan 2017 04:00:23 -0800 (PST) From: Alexander Nusov Mime-Version: 1.0 (Mac OS X Mail 10.2 \(3259\)) Subject: Xen on FreeBSD 11: Cannot boot from QCOW2 properly (waiting for XENBUS, xenbusb_nop_confighook_cb) Message-Id: <82F49C3C-07AC-4743-A800-1C101D0FE3C7@nfvexpress.com> Date: Mon, 23 Jan 2017 14:59:32 +0300 To: freebsd-virtualization@freebsd.org X-Mailer: Apple Mail (2.3259) Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 23 Jan 2017 12:00:41 -0000 Hello, I'm trying to launch a HVM DomU guest from QCOW2 image by using PV = driver on FreeBSD 11.0-RELEASE. The issue is that guest cannot connect to the device/vbd and requires to = wait for 4 minutes to proceed, it goes through the countdown and starts = fine (disk, networking) [ 6.684115] XENBUS: Waiting for devices to initialise: = 25s...20s...15s...10s...5s...0s...235s...230s...225s...220s...215s...210s.= ..205s...200s...195s...190s...185s...180s...175s...170s...165s...160s...15= 5s...150s...145s...140s...135s...130s...125s...120s...115s...110s...105s..= .100s...95s...90s...85s...80s...75s...70s...65s...60s...55s...50s...45s...= 40s...35s...30s...25s...20s...15s...10s...5s...0s... [ 271.591403] XENBUS: Timeout connecting to device: device/vbd/51712 = (local state 3, remote state 1) [ 271.599963] XENBUS: Device with no driver: device/vkbd/0 [ 271.604249] Magic number: 1:453:334 ... login:=20 Unlike Linux It's impossible to boot FreeBSD 11 guests from QCOW2 = (xenbusb_nop_confighook_cb timeout) Steps to reproduce: 1. Download qcow2 cirros image (small linux)=20 http://download.cirros-cloud.net/0.3.4/cirros-0.3.4-x86_64-disk.img = # file cirros-0.3.4-x86_64-disk.img=20 cirros-0.3.4-x86_64-disk.img: QEMU QCOW Image (v2), 41126400 bytes 2. create DomU from config bellow xl create -c config.cfg builder =3D "hvm" memory =3D 512 vcpus =3D 2 name =3D "cirros" disk =3D [ 'file:qcow2:/root/cirros-0.3.4-x86_64-disk.img,xvda,w' ] boot =3D "c"=20 vnc =3D 1 vnclisten =3D "0.0.0.0" usbdevice =3D 'tablet' on_poweroff =3D 'destroy' on_reboot =3D 'restart' on_crash =3D 'restart' acpi =3D 1 serial =3D 'pty' I've also tried multiple configurations like tap:qcow2:. tap2:qcow2:, = aio:, switching from xen bus to ide. didn't work. The only driver that had no issues was PHY but it supports only RAW = images. Is that a bug or I'm missing something? # pkg info | grep xen xen-4.7.0_2 Xen Hypervisor meta port xen-kernel-4.7.1_3 Hypervisor using a microkernel design xen-tools-4.7.1_1 Xen management tool, based on LibXenlight # cat /boot/loader.conf=20 hw.pci.mcfg=3D0 xen_kernel=3D"/boot/xen" xen_cmdline=3D"dom0_mem=3D8192M dom0_max_vcpus=3D8 dom0pvh=3D1 = com1=3D115200,8n1 guest_loglvl=3Dall loglvl=3Dall" # xenstore-ls -p 4 =3D "" . . . . . . . . . . . . . . . . . . . . . . . . . . (n0,r4) vm =3D "/vm/94b147df-e15d-11e6-a685-002590d7eca6" . . . . . (n0,r4) name =3D "cirros" . . . . . . . . . . . . . . . . . . . . . (n0,r4) cpu =3D "" . . . . . . . . . . . . . . . . . . . . . . . . (n0,r4) 0 =3D "" . . . . . . . . . . . . . . . . . . . . . . . . . (n0,r4) availability =3D "online" . . . . . . . . . . . . . . . . (n0,r4) 1 =3D "" . . . . . . . . . . . . . . . . . . . . . . . . . (n0,r4) availability =3D "online" . . . . . . . . . . . . . . . . (n0,r4) memory =3D "" . . . . . . . . . . . . . . . . . . . . . . . (n0,r4) static-max =3D "4194304" . . . . . . . . . . . . . . . . . (n0,r4) target =3D "4186112" . . . . . . . . . . . . . . . . . . . (n0,r4) videoram =3D "8192" . . . . . . . . . . . . . . . . . . . (n0,r4) device =3D "" . . . . . . . . . . . . . . . . . . . . . . . (n0,r4) suspend =3D "" . . . . . . . . . . . . . . . . . . . . . . (n0,r4) event-channel =3D "" . . . . . . . . . . . . . . . . . . (n4) vbd =3D "" . . . . . . . . . . . . . . . . . . . . . . . . (n0,r4) 51712 =3D "" . . . . . . . . . . . . . . . . . . . . . . (n4,r0) backend =3D "/local/domain/0/backend/qdisk/4/51712" . . (n4,r0) backend-id =3D "0" . . . . . . . . . . . . . . . . . . . (n4,r0) state =3D "3" . . . . . . . . . . . . . . . . . . . . . (n4,r0) virtual-device =3D "51712" . . . . . . . . . . . . . . . (n4,r0) device-type =3D "disk" . . . . . . . . . . . . . . . . . (n4,r0) ring-ref =3D "8" . . . . . . . . . . . . . . . . . . . . (n4,r0) event-channel =3D "18" . . . . . . . . . . . . . . . . . (n4,r0) protocol =3D "x86_64-abi" . . . . . . . . . . . . . . . (n4,r0) vkbd =3D "" . . . . . . . . . . . . . . . . . . . . . . . (n0,r4) 0 =3D "" . . . . . . . . . . . . . . . . . . . . . . . . (n4,r0) backend =3D "/local/domain/0/backend/vkbd/4/0" . . . . . (n4,r0) backend-id =3D "0" . . . . . . . . . . . . . . . . . . . (n4,r0) state =3D "1" . . . . . . . . . . . . . . . . . . . . . (n4,r0) control =3D "" . . . . . . . . . . . . . . . . . . . . . . (n0,r4) shutdown =3D "" . . . . . . . . . . . . . . . . . . . . . (n4) platform-feature-multiprocessor-suspend =3D "1" . . . . . (n0,r4) platform-feature-xs_reset_watches =3D "1" . . . . . . . . (n0,r4) hvmloader =3D "" . . . . . . . . . . . . . . . . . . . . . (n0,r4) bios =3D "seabios" . . . . . . . . . . . . . . . . . . . . (n0,r4) allow-memory-relocate =3D "0" . . . . . . . . . . . . . . (n0,r4) data =3D "" . . . . . . . . . . . . . . . . . . . . . . . . (n4) drivers =3D "" . . . . . . . . . . . . . . . . . . . . . . (n4) feature =3D "" . . . . . . . . . . . . . . . . . . . . . . (n4) attr =3D "" . . . . . . . . . . . . . . . . . . . . . . . . (n4) domid =3D "4" . . . . . . . . . . . . . . . . . . . . . . . (n0,r4) store =3D "" . . . . . . . . . . . . . . . . . . . . . . . (n0,r4) port =3D "1" . . . . . . . . . . . . . . . . . . . . . . . (n0,r4) ring-ref =3D "1044476" . . . . . . . . . . . . . . . . . . (n0,r4) platform =3D "" . . . . . . . . . . . . . . . . . . . . . . (n0,r4) acpi =3D "1" . . . . . . . . . . . . . . . . . . . . . . . (n0,r4) acpi_s3 =3D "1" . . . . . . . . . . . . . . . . . . . . . (n0,r4) acpi_s4 =3D "1" . . . . . . . . . . . . . . . . . . . . . (n0,r4) console =3D "" . . . . . . . . . . . . . . . . . . . . . . (n0,r4) backend =3D "/local/domain/0/backend/console/4/0" . . . . (n0,r4) backend-id =3D "0" . . . . . . . . . . . . . . . . . . . . (n4,r0) limit =3D "1048576" . . . . . . . . . . . . . . . . . . . (n0,r4) type =3D "xenconsoled" . . . . . . . . . . . . . . . . . . (n0,r4) output =3D "pty" . . . . . . . . . . . . . . . . . . . . . (n0,r4) tty =3D "/dev/pts/1" . . . . . . . . . . . . . . . . . . . (n0,r4) port =3D "2" . . . . . . . . . . . . . . . . . . . . . . . (n0,r4) ring-ref =3D "1044479" . . . . . . . . . . . . . . . . . . (n0,r4) vnc-listen =3D "0.0.0.0" . . . . . . . . . . . . . . . . . (n0,r4) vnc-port =3D "5900" . . . . . . . . . . . . . . . . . . . (n0,r4) image =3D "" . . . . . . . . . . . . . . . . . . . . . . . (n0,r4) device-model-pid =3D "3255" . . . . . . . . . . . . . . . (n0,r4) serial =3D "" . . . . . . . . . . . . . . . . . . . . . . . (n0,r4) 0 =3D "" . . . . . . . . . . . . . . . . . . . . . . . . . (n0,r4) tty =3D "/dev/pts/2" . . . . . . . . . . . . . . . . . . (n0,r4) Thanks, Alex