Skip site navigation (1)Skip section navigation (2)
Date:      Mon, 23 Jan 2017 14:59:32 +0300
From:      Alexander Nusov <alexander.nusov@nfvexpress.com>
To:        freebsd-virtualization@freebsd.org
Subject:   Xen on FreeBSD 11: Cannot boot from QCOW2 properly (waiting for XENBUS, xenbusb_nop_confighook_cb)
Message-ID:  <82F49C3C-07AC-4743-A800-1C101D0FE3C7@nfvexpress.com>

next in thread | raw e-mail | index | archive | help
Hello,

I'm trying to launch a HVM DomU guest from QCOW2 image by using PV =
driver on FreeBSD 11.0-RELEASE.
The issue is that guest cannot connect to the device/vbd and requires to =
wait for 4 minutes to proceed, it goes through the countdown and starts =
fine (disk, networking)

[    6.684115] XENBUS: Waiting for devices to initialise: =
25s...20s...15s...10s...5s...0s...235s...230s...225s...220s...215s...210s.=
..205s...200s...195s...190s...185s...180s...175s...170s...165s...160s...15=
5s...150s...145s...140s...135s...130s...125s...120s...115s...110s...105s..=
.100s...95s...90s...85s...80s...75s...70s...65s...60s...55s...50s...45s...=
40s...35s...30s...25s...20s...15s...10s...5s...0s...
[  271.591403] XENBUS: Timeout connecting to device: device/vbd/51712 =
(local state 3, remote state 1)
[  271.599963] XENBUS: Device with no driver: device/vkbd/0
[  271.604249]   Magic number: 1:453:334
...
login:=20


Unlike Linux It's impossible to boot FreeBSD 11 guests from QCOW2 =
(xenbusb_nop_confighook_cb timeout)

Steps to reproduce:
1. Download qcow2 cirros image (small linux)=20
http://download.cirros-cloud.net/0.3.4/cirros-0.3.4-x86_64-disk.img =
<http://download.cirros-cloud.net/0.3.4/cirros-0.3.4-x86_64-disk.img>;
# file cirros-0.3.4-x86_64-disk.img=20
cirros-0.3.4-x86_64-disk.img: QEMU QCOW Image (v2), 41126400 bytes
2. create DomU from config bellow xl create -c config.cfg

builder =3D "hvm"
memory =3D 512
vcpus =3D 2
name =3D "cirros"
disk =3D [ 'file:qcow2:/root/cirros-0.3.4-x86_64-disk.img,xvda,w' ]
boot =3D "c"=20
vnc =3D 1
vnclisten =3D "0.0.0.0"
usbdevice =3D 'tablet'
on_poweroff =3D 'destroy'
on_reboot =3D 'restart'
on_crash =3D 'restart'
acpi =3D 1
serial =3D 'pty'

I've also tried multiple configurations like tap:qcow2:. tap2:qcow2:, =
aio:, switching from xen bus to ide. didn't work.
The only driver that had no issues was PHY but it supports only RAW =
images.

Is that a bug or I'm missing something?

# pkg info | grep xen
xen-4.7.0_2                    Xen Hypervisor meta port
xen-kernel-4.7.1_3             Hypervisor using a microkernel design
xen-tools-4.7.1_1              Xen management tool, based on LibXenlight

# cat /boot/loader.conf=20
hw.pci.mcfg=3D0
xen_kernel=3D"/boot/xen"
xen_cmdline=3D"dom0_mem=3D8192M dom0_max_vcpus=3D8 dom0pvh=3D1 =
com1=3D115200,8n1 guest_loglvl=3Dall loglvl=3Dall"

# xenstore-ls -p
  4 =3D "" . . . . . . . . . . . . . . . . . . . . . . . . . .  (n0,r4)
   vm =3D "/vm/94b147df-e15d-11e6-a685-002590d7eca6" . . . . .  (n0,r4)
   name =3D "cirros" . . . . . . . . . . . . . . . . . . . . .  (n0,r4)
   cpu =3D ""  . . . . . . . . . . . . . . . . . . . . . . . .  (n0,r4)
    0 =3D "" . . . . . . . . . . . . . . . . . . . . . . . . .  (n0,r4)
     availability =3D "online" . . . . . . . . . . . . . . . .  (n0,r4)
    1 =3D "" . . . . . . . . . . . . . . . . . . . . . . . . .  (n0,r4)
     availability =3D "online" . . . . . . . . . . . . . . . .  (n0,r4)
   memory =3D "" . . . . . . . . . . . . . . . . . . . . . . .  (n0,r4)
    static-max =3D "4194304" . . . . . . . . . . . . . . . . .  (n0,r4)
    target =3D "4186112" . . . . . . . . . . . . . . . . . . .  (n0,r4)
    videoram =3D "8192"  . . . . . . . . . . . . . . . . . . .  (n0,r4)
   device =3D "" . . . . . . . . . . . . . . . . . . . . . . .  (n0,r4)
    suspend =3D "" . . . . . . . . . . . . . . . . . . . . . .  (n0,r4)
     event-channel =3D ""  . . . . . . . . . . . . . . . . . .  (n4)
    vbd =3D "" . . . . . . . . . . . . . . . . . . . . . . . .  (n0,r4)
     51712 =3D ""  . . . . . . . . . . . . . . . . . . . . . .  (n4,r0)
      backend =3D "/local/domain/0/backend/qdisk/4/51712"  . .  (n4,r0)
      backend-id =3D "0" . . . . . . . . . . . . . . . . . . .  (n4,r0)
      state =3D "3"  . . . . . . . . . . . . . . . . . . . . .  (n4,r0)
      virtual-device =3D "51712" . . . . . . . . . . . . . . .  (n4,r0)
      device-type =3D "disk" . . . . . . . . . . . . . . . . .  (n4,r0)
      ring-ref =3D "8" . . . . . . . . . . . . . . . . . . . .  (n4,r0)
      event-channel =3D "18" . . . . . . . . . . . . . . . . .  (n4,r0)
      protocol =3D "x86_64-abi"  . . . . . . . . . . . . . . .  (n4,r0)
    vkbd =3D ""  . . . . . . . . . . . . . . . . . . . . . . .  (n0,r4)
     0 =3D ""  . . . . . . . . . . . . . . . . . . . . . . . .  (n4,r0)
      backend =3D "/local/domain/0/backend/vkbd/4/0" . . . . .  (n4,r0)
      backend-id =3D "0" . . . . . . . . . . . . . . . . . . .  (n4,r0)
      state =3D "1"  . . . . . . . . . . . . . . . . . . . . .  (n4,r0)
   control =3D ""  . . . . . . . . . . . . . . . . . . . . . .  (n0,r4)
    shutdown =3D ""  . . . . . . . . . . . . . . . . . . . . .  (n4)
    platform-feature-multiprocessor-suspend =3D "1"  . . . . .  (n0,r4)
    platform-feature-xs_reset_watches =3D "1"  . . . . . . . .  (n0,r4)
   hvmloader =3D ""  . . . . . . . . . . . . . . . . . . . . .  (n0,r4)
    bios =3D "seabios" . . . . . . . . . . . . . . . . . . . .  (n0,r4)
    allow-memory-relocate =3D "0"  . . . . . . . . . . . . . .  (n0,r4)
   data =3D "" . . . . . . . . . . . . . . . . . . . . . . . .  (n4)
   drivers =3D ""  . . . . . . . . . . . . . . . . . . . . . .  (n4)
   feature =3D ""  . . . . . . . . . . . . . . . . . . . . . .  (n4)
   attr =3D "" . . . . . . . . . . . . . . . . . . . . . . . .  (n4)
   domid =3D "4" . . . . . . . . . . . . . . . . . . . . . . .  (n0,r4)
   store =3D ""  . . . . . . . . . . . . . . . . . . . . . . .  (n0,r4)
    port =3D "1" . . . . . . . . . . . . . . . . . . . . . . .  (n0,r4)
    ring-ref =3D "1044476" . . . . . . . . . . . . . . . . . .  (n0,r4)
   platform =3D "" . . . . . . . . . . . . . . . . . . . . . .  (n0,r4)
    acpi =3D "1" . . . . . . . . . . . . . . . . . . . . . . .  (n0,r4)
    acpi_s3 =3D "1"  . . . . . . . . . . . . . . . . . . . . .  (n0,r4)
    acpi_s4 =3D "1"  . . . . . . . . . . . . . . . . . . . . .  (n0,r4)
   console =3D ""  . . . . . . . . . . . . . . . . . . . . . .  (n0,r4)
    backend =3D "/local/domain/0/backend/console/4/0"  . . . .  (n0,r4)
    backend-id =3D "0" . . . . . . . . . . . . . . . . . . . .  (n4,r0)
    limit =3D "1048576"  . . . . . . . . . . . . . . . . . . .  (n0,r4)
    type =3D "xenconsoled" . . . . . . . . . . . . . . . . . .  (n0,r4)
    output =3D "pty" . . . . . . . . . . . . . . . . . . . . .  (n0,r4)
    tty =3D "/dev/pts/1" . . . . . . . . . . . . . . . . . . .  (n0,r4)
    port =3D "2" . . . . . . . . . . . . . . . . . . . . . . .  (n0,r4)
    ring-ref =3D "1044479" . . . . . . . . . . . . . . . . . .  (n0,r4)
    vnc-listen =3D "0.0.0.0" . . . . . . . . . . . . . . . . .  (n0,r4)
    vnc-port =3D "5900"  . . . . . . . . . . . . . . . . . . .  (n0,r4)
   image =3D ""  . . . . . . . . . . . . . . . . . . . . . . .  (n0,r4)
    device-model-pid =3D "3255"  . . . . . . . . . . . . . . .  (n0,r4)
   serial =3D "" . . . . . . . . . . . . . . . . . . . . . . .  (n0,r4)
    0 =3D "" . . . . . . . . . . . . . . . . . . . . . . . . .  (n0,r4)
     tty =3D "/dev/pts/2"  . . . . . . . . . . . . . . . . . .  (n0,r4)


Thanks,
Alex






Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?82F49C3C-07AC-4743-A800-1C101D0FE3C7>