From owner-freebsd-virtualization@freebsd.org Sun Jun 5 18:33:23 2016 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8BABAB6B83B for ; Sun, 5 Jun 2016 18:33:23 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12]) by mx1.freebsd.org (Postfix) with ESMTP id 4C11F1CA9 for ; Sun, 5 Jun 2016 18:33:23 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from iredmail.onthenet.com.au (iredmail.onthenet.com.au [203.13.68.150]) by alto.onthenet.com.au (Postfix) with ESMTPS id 11CF320A40F4 for ; Mon, 6 Jun 2016 04:27:44 +1000 (AEST) Received: from localhost (iredmail.onthenet.com.au [127.0.0.1]) by iredmail.onthenet.com.au (Postfix) with ESMTP id 0D0BF2810BD for ; Mon, 6 Jun 2016 04:27:44 +1000 (AEST) X-Amavis-Modified: Mail body modified (using disclaimer) - iredmail.onthenet.com.au Received: from iredmail.onthenet.com.au ([127.0.0.1]) by localhost (iredmail.onthenet.com.au [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id DyC9hPrOLqbq for ; Mon, 6 Jun 2016 04:27:43 +1000 (AEST) Received: from [192.168.1.168] (c-50-131-190-8.hsd1.ca.comcast.net [50.131.190.8]) by iredmail.onthenet.com.au (Postfix) with ESMTPSA id 48CA92804FF; Mon, 6 Jun 2016 04:27:40 +1000 (AEST) Subject: Re: bhyve graphics support To: Yamagi Burmeister References: <442c6d8f-2b64-c88b-382a-cf73eb6f7404@freebsd.org> <20160527104405.GA15808@e-new.0x20.net> <20160527115540.GB15808@e-new.0x20.net> <20160527141557.e2ee91ee437a3893f818c468@yamagi.org> <1fb4af03-1131-011b-faf7-fa993862c2fa@freebsd.org> <20160530092449.399f5c4f315d12e1144b49b8@yamagi.org> Cc: freebsd-virtualization@freebsd.org From: Peter Grehan Message-ID: Date: Sun, 5 Jun 2016 11:27:41 -0700 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:45.0) Gecko/20100101 Thunderbird/45.1.1 MIME-Version: 1.0 In-Reply-To: <20160530092449.399f5c4f315d12e1144b49b8@yamagi.org> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-CMAE-Score: 0 X-CMAE-Analysis: v=2.2 cv=LvDQ8TVc c=1 sm=1 tr=0 a=A6CF0fG5TOl4vs6YHvqXgw==:117 a=KizCzvWM+ZNP07iIuOu4gA==:17 a=N659UExz7-8A:10 a=pD_ry4oyNxEA:10 a=6I5d2MoRAAAA:8 a=MZgT_uLyhdqWSMgR55AA:9 a=IjZwj45LgO3ly-622nXo:22 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 05 Jun 2016 18:33:23 -0000 Hi Yamagi, >> XHCI isn't in Windows7 so you can just remove that config line, >> pushing mouse input through the PS2 mouse. > > That was a little bit strange, it seemed like the emulated ps/2 devices > just wouldn't work on a Win 7 VM. The "atkbd data buffer full" may be > an indication for not delivered interrupts or something like that. > After I've rebooted the host things suddenly started to work. Maybe > some kind of system inconsistency. It was some 11-CURRENT with about 4 > weeks uptime. Was the VM destroyed between invocations ? If not, then it's probably a bug in bhyve with not resetting h/w state correctly. > It may be a good idea to add a note to the Windows installation guide > at https://people.freebsd.org/~grehan/bhyve_uefi/windows_install.txt > that Window 7 requieres AHCI disks with a blocksize if 512 bytes. > Otherwise the installation will fail with "Windows Setup could not > configure Windows on this computer?s hardware" and Windows Update will > bail out with error 0xc8000247. Done, and will also update the wiki with the error. later, Peter. From owner-freebsd-virtualization@freebsd.org Sun Jun 5 21:00:10 2016 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4A457B6A719 for ; Sun, 5 Jun 2016 21:00:10 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 288F21F89 for ; Sun, 5 Jun 2016 21:00:10 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u55L01AH043750 for ; Sun, 5 Jun 2016 21:00:10 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <201606052100.u55L01AH043750@kenobi.freebsd.org> From: bugzilla-noreply@FreeBSD.org To: freebsd-virtualization@FreeBSD.org Subject: Problem reports for freebsd-virtualization@FreeBSD.org that need special attention Date: Sun, 05 Jun 2016 21:00:10 +0000 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 05 Jun 2016 21:00:10 -0000 To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- In Progress | 202321 | [bhyve,patch] More verbose error reporting in bhy New | 202322 | [bhyve,patch] add option to have bhyve write its 2 problems total for which you should take action. From owner-freebsd-virtualization@freebsd.org Tue Jun 7 06:31:39 2016 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 566EBB6D25F for ; Tue, 7 Jun 2016 06:31:39 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12]) by mx1.freebsd.org (Postfix) with ESMTP id DF50F1FF1 for ; Tue, 7 Jun 2016 06:31:38 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from iredmail.onthenet.com.au (iredmail.onthenet.com.au [203.13.68.150]) by alto.onthenet.com.au (Postfix) with ESMTPS id 983A7209C02B for ; Tue, 7 Jun 2016 16:31:26 +1000 (AEST) Received: from localhost (iredmail.onthenet.com.au [127.0.0.1]) by iredmail.onthenet.com.au (Postfix) with ESMTP id 922DD280F66 for ; Tue, 7 Jun 2016 16:31:26 +1000 (AEST) X-Amavis-Modified: Mail body modified (using disclaimer) - iredmail.onthenet.com.au Received: from iredmail.onthenet.com.au ([127.0.0.1]) by localhost (iredmail.onthenet.com.au [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id a2satCYGUZn2 for ; Tue, 7 Jun 2016 16:31:26 +1000 (AEST) Received: from Peters-MacBook-Pro-2.local (c-67-180-92-13.hsd1.ca.comcast.net [67.180.92.13]) by iredmail.onthenet.com.au (Postfix) with ESMTPSA id 6C546280901; Tue, 7 Jun 2016 16:31:24 +1000 (AEST) Subject: Re: a bhyve and Windows Server 2012R2 story To: Evan Rowley References: Cc: freebsd-virtualization@freebsd.org From: Peter Grehan Message-ID: <9147c070-f7ff-796f-e30c-7015f53b83c7@freebsd.org> Date: Mon, 6 Jun 2016 23:31:26 -0700 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:45.0) Gecko/20100101 Thunderbird/45.1.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-CMAE-Score: 0 X-CMAE-Analysis: v=2.2 cv=LvDQ8TVc c=1 sm=1 tr=0 a=A6CF0fG5TOl4vs6YHvqXgw==:117 a=5eVCmCvhg37cu/pjidAGzw==:17 a=N659UExz7-8A:10 a=pD_ry4oyNxEA:10 a=6I5d2MoRAAAA:8 a=qO7QXkQiik0QAVnzuj8A:9 a=PDNR5vPgHKEA:10 a=c43ZT4pwriIA:10 a=IjZwj45LgO3ly-622nXo:22 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 07 Jun 2016 06:31:39 -0000 Hi Evan, Thanks for persevering :) > [root@true11] /mnt/vm0/ds0/iso# pkg info | grep 7z > p7zip-15.14 File archiver with high compression ratio > > Unfortunately, it seems this version of 7z was not able to extract the > UDF ISO correctly. I don't have that exact version of 2k12 but I was able to extract a 2k15 tp5 ISO and verify that it was the same with 7z 15.14 and the older 9.38 version. I'll try with some others and see how it goes. > I also added NetKVM drivers from this version virtio-win-0.1.102.iso, > not virtio-win-0.1.96.iso as was specified in the guide. Glad to hear the newer version worked. The 0.96 version should also be fine. > My VM had a problem. It did boot and the SAC channels did start - but > somewhere after WIMApplyImage message was displayed in the SACSetupAct > - the VM would hang and top would show the bhyve process at 99% WCPU. > I destroyed the VM after it hanged like this for 1 hour. It took some > guessing, but eventually I recalled reading somewhere - possibly on a > KVM/QEMU/Xen wiki page - that IOMMU is needed for more than 1 core. Shouldn't be anything to do with the IOMMU. I have noticed that Windows installs on AMD machines require 2 or more vCPUs. Still working that one out. > I had difficulty at first with the network configuration. TrueOS has > ipfw enabled and I suspect it was originally blocking my RDP traffic. > Also, I did not have any successful network connections before I set > and loaded what's described in 21.7.7 Persistent Configuration: > https://www.freebsd.org/doc/handbook/virtualization-host-bhyve.html > > At first, I attempted to RDP to an IP I had assigned from the SAC > channel using the i <#> command. This never > worked and I am not sure why. Eventually, I created a CMD channel, > then used ipconfig to determine that Windows had leased a different IP > via DHCP. Using RDP to reach the DHCP IP worked! Oddly, I did not see > the static IP I had set in SAC updated with the DHCP one - but I > checked later, and it was updated. I'm new to SAC and maybe this is > just one of it's quirks. Not a FreeBSD problem in any case, but > perhaps a stumbling block others on freebsd-virtualization may > encounter. The AutoUnattend installation file specifies DHCP for config. If you want a fixed address, you should be able to get it either by modifying the AutoUnatted file prior to repack, or removing the DHCP config lines and configuring via SAC. later, Peter. From owner-freebsd-virtualization@freebsd.org Tue Jun 7 17:38:23 2016 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 43F58B6E663 for ; Tue, 7 Jun 2016 17:38:23 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 3446D1F10 for ; Tue, 7 Jun 2016 17:38:23 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u57HcNow082778 for ; Tue, 7 Jun 2016 17:38:23 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-virtualization@FreeBSD.org Subject: [Bug 210111] [bhyve][patch] print list of supported PCI and LPC devices Date: Tue, 07 Jun 2016 17:38:23 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: patch X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: novel@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 07 Jun 2016 17:38:23 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D210111 Roman Bogorodskiy changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|freebsd-bugs@FreeBSD.org |freebsd-virtualization@Free | |BSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Tue Jun 7 18:59:24 2016 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id CC691B6EB73 for ; Tue, 7 Jun 2016 18:59:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id BC23B1A6F for ; Tue, 7 Jun 2016 18:59:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u57IxNQr044710 for ; Tue, 7 Jun 2016 18:59:24 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-virtualization@FreeBSD.org Subject: [Bug 202321] [bhyve, patch] More verbose error reporting in bhyve for backing images Date: Tue, 07 Jun 2016 18:59:24 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: patch X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: grehan@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-virtualization@FreeBSD.org X-Bugzilla-Flags: mfc-stable10? X-Bugzilla-Changed-Fields: resolution bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 07 Jun 2016 18:59:24 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D202321 Peter Grehan changed: What |Removed |Added ---------------------------------------------------------------------------- Resolution|--- |FIXED Status|In Progress |Closed --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Wed Jun 8 22:35:25 2016 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7362FB6F3BA; Wed, 8 Jun 2016 22:35:25 +0000 (UTC) (envelope-from saper@saper.info) Received: from m.saper.info (m.saper.info [IPv6:2a01:4f8:a0:7383::]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "m.saper.info", Issuer "Marcin Cieslak 2016" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id F03891080; Wed, 8 Jun 2016 22:35:24 +0000 (UTC) (envelope-from saper@saper.info) Received: from m.saper.info (saper@m.saper.info [IPv6:2a01:4f8:a0:7383::]) by m.saper.info (8.15.2/8.15.2) with ESMTPS id u58MZMq9065253 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Wed, 8 Jun 2016 22:35:22 GMT (envelope-from saper@saper.info) Received: from localhost (saper@localhost) by m.saper.info (8.15.2/8.15.2/Submit) with ESMTP id u58MZMpT065250; Wed, 8 Jun 2016 22:35:22 GMT (envelope-from saper@saper.info) X-Authentication-Warning: m.saper.info: saper owned process doing -bs Date: Wed, 8 Jun 2016 22:35:22 +0000 From: Marcin Cieslak To: =?ISO-8859-15?Q?Roger_Pau_Monn=E9?= cc: freebsd-xen@FreeBSD.org, freebsd-virtualization@freebsd.org, xen-devel@lists.xenproject.org Subject: Re: HEADS UP: Imported Xen 4.7 and blkback changes - domU respawning on_crash In-Reply-To: Message-ID: References: <20160603120921.y5l362zgrhf4fdcb@mac> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=iso-8859-15 Content-Transfer-Encoding: 8BIT X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 08 Jun 2016 22:35:25 -0000 On Wed, 8 Jun 2016, Marcin Cieslak wrote: > On Fri, 3 Jun 2016, Roger Pau Monné wrote: > > > Hello, > > > > First of all, this message is only relevant to those that use FreeBSD as > > Dom0 (host), not as a DomU (guest), so don't panic. > > > > I've imported the latest Xen version (4.7-rc4) into the ports tree, it's > > still not the final version, but it's quite close, so we better start > > testing it to make sure it works fine with FreeBSD. One issue maybe unrelated to FreeBSD: This domain: builder = "hvm" memory = 4096 vcpus = 2 name = "Windows2016" disk = [ '/dev/zvol/zroot/windows0,raw,hda,w', '/dev/zvol/zroot/vs2013,raw,hdb,w', # '/root/win/install.iso,raw,hdc:cdrom,r' ] boot = "c" # Boot to hard disk image vnc = 2 #vnclisten = "0.0.0.0" usbdevice = 'tablet' on_poweroff = 'destroy' on_reboot = 'restart' on_crash = 'restart' acpi = 1 bios = 'ovmf' vif = [ 'bridge=bridge0,mac=00:16:3e:5d:0d:48' ] videoram=16 vga = "stdvga" crashes because I didn't have ovmf image: (d203) HVM Loader (d203) Detected Xen v4.7.0-rc (d203) Xenbus rings @0xfeffc000, event channel 1 (d203) Unknown BIOS ovmf, no ROM image found (d203) *** HVMLoader bug at hvmloader.c:229 (d203) *** HVMLoader crashed. But I seem unable to kill it with "xl destroy" - it keeps respawning again: Windows2016 211 4079 1 --p--- 0.0 Windows2016 213 4096 1 --psc- 0.0 (disappears) Windows2016 221 4096 1 --psc- 0.0 (null) 221 147 1 --psc- 0.0 ... ... I have finally managed to snatch it by issuing this a few times, after changing the "on_crash" to 'destroy': # xl config-update Windows2016 xen/windows-run.cfg WARNING: xl now has better capability to manage domain configuration, avoid using this command when possible setting dom243 configuration Marcin From owner-freebsd-virtualization@freebsd.org Thu Jun 9 00:17:02 2016 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D4E2AB703D3; Thu, 9 Jun 2016 00:17:02 +0000 (UTC) (envelope-from saper@saper.info) Received: from m.saper.info (m.saper.info [IPv6:2a01:4f8:a0:7383::]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "m.saper.info", Issuer "Marcin Cieslak 2016" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 5E4B21D6D; Thu, 9 Jun 2016 00:17:02 +0000 (UTC) (envelope-from saper@saper.info) Received: from m.saper.info (saper@m.saper.info [IPv6:2a01:4f8:a0:7383::]) by m.saper.info (8.15.2/8.15.2) with ESMTPS id u590H0UT065998 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Thu, 9 Jun 2016 00:17:00 GMT (envelope-from saper@saper.info) Received: from localhost (saper@localhost) by m.saper.info (8.15.2/8.15.2/Submit) with ESMTP id u590Gxd7065995; Thu, 9 Jun 2016 00:16:59 GMT (envelope-from saper@saper.info) X-Authentication-Warning: m.saper.info: saper owned process doing -bs Date: Thu, 9 Jun 2016 00:16:59 +0000 From: Marcin Cieslak To: =?ISO-8859-15?Q?Roger_Pau_Monn=E9?= cc: freebsd-xen@FreeBSD.org, xen-devel@lists.xenproject.org, freebsd-virtualization@freebsd.org Subject: Re: HEADS UP: Imported Xen 4.7: no blkback In-Reply-To: <20160603120921.y5l362zgrhf4fdcb@mac> Message-ID: References: <20160603120921.y5l362zgrhf4fdcb@mac> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=ISO-8859-15 Content-Transfer-Encoding: 8BIT X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 09 Jun 2016 00:17:02 -0000 On Fri, 3 Jun 2016, Roger Pau Monné wrote: > One of the more relevant changes in 4.7 regarding FreeBSD is the support for > block hotplug scripts. This means that we now have the option to use > backends different than simple block or regular files, provided that someone > writes the proper hotplug scripts to attach them (I've heard there are some > iSCSI hotplug scripts around). This however requires changes in blkback, so > if you plan to use the Xen 4.7 port, please make sure that you are running a > kernel that contains revision r301269 (or any later version). The same also I am running it with r301685 and the HVM guests have some trouble with block devices. SeaBIOS does not find /dev/zvol/zroot/freebsd1,raw,xvda,w to boot FreeBSD from, after chaging to "hda" I get up to the kernel mountroot prompt (Xen block devices seem to be detected in dmesg). What used to be Windows 2016 domU with /dev/zvol/zroot/windows0,raw,hda,w ends up in the Tianocore UEFI shell. Block devices seem to be available, I can even list the fs0: partition, but no booting further possible. Marcin # more freebsd.cfg builder = "hvm" name = "FreeBSD" disk = [ '/dev/zvol/zroot/freebsd1,raw,xvda,w', '/dev/zvol/zroot/freebsd2,raw,xvdb,w' ] boot = "c" #usbdevice = 'tablet' #nographics = 1 serial = [ "file:/tmp/boot.log" ] vnc = 1 #vnclisten = '0.0.0.0' vif = ['bridge=bridge0,mac=00:02:04:08:fd:f0'] memory=2048 vcpus=1 vga = "cirrus" videoram = 16 # more windows-run.cfg builder = "hvm" memory = 4096 vcpus = 2 name = "Windows2016" disk = [ '/dev/zvol/zroot/windows0,raw,hda,w', '/dev/zvol/zroot/vs2013,raw,hdb,w', # '/root/win/install.iso,raw,hdc:cdrom,r' ] boot = "c" # Boot to hard disk image vnc = 2 #vnclisten = "0.0.0.0" usbdevice = 'tablet' on_poweroff = 'destroy' on_reboot = 'restart' #on_crash = 'restart' on_crash = 'destroy' acpi = 1 bios = 'ovmf' vif = [ 'bridge=bridge0,mac=00:16:3e:5d:0d:48' ] videoram=16 vga = "stdvga" From owner-freebsd-virtualization@freebsd.org Thu Jun 9 07:44:33 2016 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0F54BADC07D; Thu, 9 Jun 2016 07:44:33 +0000 (UTC) (envelope-from royger@gmail.com) Received: from mail-wm0-x230.google.com (mail-wm0-x230.google.com [IPv6:2a00:1450:400c:c09::230]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 994991B96; Thu, 9 Jun 2016 07:44:32 +0000 (UTC) (envelope-from royger@gmail.com) Received: by mail-wm0-x230.google.com with SMTP id k204so47699619wmk.0; Thu, 09 Jun 2016 00:44:32 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=sender:date:from:to:cc:subject:message-id:references:mime-version :content-disposition:content-transfer-encoding:in-reply-to :user-agent; bh=QwO/iVi955J6ZFFb3I8jauzwxIK2qnuOIm0qRljetlY=; b=wcy90EUzuOoXDHPuwz/zQTXwE8sba0q6T3+p/dwpyI9Lxr2zBKylvMNvCwaUahcCwG AGiPA8kK5Vehxaeu/Py8ucYH+Ba758uy4Yr13sRlG9V0NQ17hh724SuYMmBk36Rr0BlZ /G/sXGmdB3VcrOIHHv0Dn76/ILTceB3Fa6Wv5vcdYCSAfQWK72VrDi3vG0koXruTLLI4 CA9DNyB0sSnygko9iaPrDdoEzBotbDwXWP++KNiUkdxt+AKw0HhtNDC9a8N9dX3qdZvn h05FWOkvbjEgKy+Zn4rcaY2rJ2vQUac0A6reQPR2s2CNUjMGJJ6gkgKyOffhdtPL3zGi qskA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:sender:date:from:to:cc:subject:message-id :references:mime-version:content-disposition :content-transfer-encoding:in-reply-to:user-agent; bh=QwO/iVi955J6ZFFb3I8jauzwxIK2qnuOIm0qRljetlY=; b=Kf7N8IcV4CfyTR4Dm8Q10imassEzhBJM6ubR15GXWFgFtdfV/QYhRfRL+Mh1pGZ/lO Ng7hGjbDbFlZx9hl7nUaxQ+Uj6RhkzYkAqBsd6rsuT6pOG/TNeuQzZoYz65xtNgwEAGR 5YvetY/71v/OcD3yYL1VFSLwJ5e63xvCkmIrXpUYVAOMSKzY5Ehx/xi+WqDMGcvMmxaD XOX4HAMj6Lqpgopt1DHCWd/yC637GLBmXJqnN/sDjsfGE3OJL67ceMg7Q18pYs/814jR 8lIwoeE+G6Q0OYqxWWI4ieqk+HvNtNUBXFWZHaPVQwRVroaHpnLuaLZ7YtsY5FUAkaLd /p8w== X-Gm-Message-State: ALyK8tJyquJHtzvNcCiClXl6vJMGYfVCwjx+/lejuZ7+Ww0TlKFZgO07KgJjrXSnp6CEIA== X-Received: by 10.194.163.166 with SMTP id yj6mr8163383wjb.116.1465458271003; Thu, 09 Jun 2016 00:44:31 -0700 (PDT) Received: from localhost (220.red-79-152-208.dynamicip.rima-tde.net. [79.152.208.220]) by smtp.gmail.com with ESMTPSA id c4sm5533606wjb.38.2016.06.09.00.44.29 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 09 Jun 2016 00:44:30 -0700 (PDT) Sender: =?UTF-8?Q?Roger_Pau_Monn=C3=A9?= Date: Thu, 9 Jun 2016 09:44:25 +0200 From: Roger Pau =?iso-8859-1?Q?Monn=E9?= To: Marcin Cieslak Cc: freebsd-xen@FreeBSD.org, freebsd-virtualization@freebsd.org, xen-devel@lists.xenproject.org Subject: Re: HEADS UP: Imported Xen 4.7 and blkback changes - domU respawning on_crash Message-ID: <20160609074425.dqstpupeqb7yueus@mac> References: <20160603120921.y5l362zgrhf4fdcb@mac> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: User-Agent: Mutt/1.6.0-neo (2016-04-07) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 09 Jun 2016 07:44:33 -0000 On Wed, Jun 08, 2016 at 10:35:22PM +0000, Marcin Cieslak wrote: > On Wed, 8 Jun 2016, Marcin Cieslak wrote: > > > On Fri, 3 Jun 2016, Roger Pau Monné wrote: > > > > > Hello, > > > > > > First of all, this message is only relevant to those that use FreeBSD as > > > Dom0 (host), not as a DomU (guest), so don't panic. > > > > > > I've imported the latest Xen version (4.7-rc4) into the ports tree, it's > > > still not the final version, but it's quite close, so we better start > > > testing it to make sure it works fine with FreeBSD. > > One issue maybe unrelated to FreeBSD: > > This domain: > > builder = "hvm" > memory = 4096 > vcpus = 2 > name = "Windows2016" > disk = [ > '/dev/zvol/zroot/windows0,raw,hda,w', > '/dev/zvol/zroot/vs2013,raw,hdb,w', > # '/root/win/install.iso,raw,hdc:cdrom,r' > ] > boot = "c" # Boot to hard disk image > vnc = 2 > #vnclisten = "0.0.0.0" > usbdevice = 'tablet' > on_poweroff = 'destroy' > on_reboot = 'restart' > on_crash = 'restart' > acpi = 1 > bios = 'ovmf' > vif = [ 'bridge=bridge0,mac=00:16:3e:5d:0d:48' ] > videoram=16 > vga = "stdvga" > > crashes because I didn't have ovmf image: > > (d203) HVM Loader > (d203) Detected Xen v4.7.0-rc > (d203) Xenbus rings @0xfeffc000, event channel 1 > (d203) Unknown BIOS ovmf, no ROM image found > (d203) *** HVMLoader bug at hvmloader.c:229 > (d203) *** HVMLoader crashed. > > But I seem unable to kill it with "xl destroy" - it keeps > respawning again: > > Windows2016 211 4079 1 --p--- 0.0 > Windows2016 213 4096 1 --psc- 0.0 > (disappears) > Windows2016 221 4096 1 --psc- 0.0 > (null) 221 147 1 --psc- 0.0 > ... > ... > > I have finally managed to snatch it by issuing this a few times, after > changing the "on_crash" to 'destroy': > > # xl config-update Windows2016 xen/windows-run.cfg > WARNING: xl now has better capability to manage domain configuration, avoid using this command when possible > setting dom243 configuration The problem is that the domain crashed so early on boot that you weren't able to destroy it, and kept rebooting due to the "on_crash = 'restart'" option. IIRC I've also used the following hacky rune in order to terminate this kind of domains: "while [ 1 ]; do xl destroy ; done", but your solution seems better. Roger. From owner-freebsd-virtualization@freebsd.org Thu Jun 9 08:03:50 2016 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id F4000ADC8AA; Thu, 9 Jun 2016 08:03:49 +0000 (UTC) (envelope-from royger@gmail.com) Received: from mail-wm0-x22a.google.com (mail-wm0-x22a.google.com [IPv6:2a00:1450:400c:c09::22a]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 8048614D3; Thu, 9 Jun 2016 08:03:49 +0000 (UTC) (envelope-from royger@gmail.com) Received: by mail-wm0-x22a.google.com with SMTP id n184so213160220wmn.1; Thu, 09 Jun 2016 01:03:49 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=sender:date:from:to:cc:subject:message-id:references:mime-version :content-disposition:content-transfer-encoding:in-reply-to :user-agent; bh=TgyMnnpyBccEzZw7NvLMgvDhsq5p9pnmaBhETU0o0pc=; b=a2XlvuMG8M7fWbC4FP0/vDgSx8C/6QuyIvP/rxMlvNB4Se83k6ICHmZidtoIjQKDPs SJ+eXFTRph2W7HvvgV7zNbBYh2EdVtPPrtl747kQ4ZgyWQI0wgApdGGwtuV4RxKu+awQ neUoKgy4oCnnOLN1cznI0R156WAdulmCfXumaYAc89JeYVHA539Ub9cSP3L70lZA9nim 2TYLEpr7VcS20d3M7YpMviJWYQqNQzHIPv9Uvp0EXDyApkVfpzoUjICemyeKWRvijjt0 VVRvq4bTW3IRyZyeMGks6MDozbeR1RFxjGZ/k7w3x+/LuzGSjg8xTagHYXYItFDH9LF+ 3INw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:sender:date:from:to:cc:subject:message-id :references:mime-version:content-disposition :content-transfer-encoding:in-reply-to:user-agent; bh=TgyMnnpyBccEzZw7NvLMgvDhsq5p9pnmaBhETU0o0pc=; b=LPaE31/5e5R3pPHxvplQkdTels/k6UqmV24EajY55NuowuOnxc1EzTEmE/VTXpgjMr lIT2IvjzZjEao8WMRowYe4B4AhRLe33lQIbrSxVznIdzvrYV33QJTbcBGjxgpNz7/sro Cl9GWQJNcqd0xV9lPmtdV1xao25zccmC1JyZreI+5ZXcEq1LCFngFahEpO7Ug3QIBqL9 p9hpDEP3k3twhC9XkFf1+EsAvRCPEsWzm8O/ke5EBziIhj0BlXp8h7R/VWzru+3gT0N5 PVwfa4mFVKl190lVm1nJ9Nv0gxfqvGZWFXGkb4BAFgdvXcViX8C+zN+lo3TF3BaSZp8Q 2kIQ== X-Gm-Message-State: ALyK8tIfhZb8Fs9Je5WfKRQ3zF5kNP4n7v4WtfHY9amxSXV1AFaqKC+QWPnkpuo4Ma3TBA== X-Received: by 10.28.43.129 with SMTP id r123mr11053521wmr.99.1465459427854; Thu, 09 Jun 2016 01:03:47 -0700 (PDT) Received: from localhost (220.red-79-152-208.dynamicip.rima-tde.net. [79.152.208.220]) by smtp.gmail.com with ESMTPSA id r16sm15367248wmb.23.2016.06.09.01.03.46 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 09 Jun 2016 01:03:47 -0700 (PDT) Sender: =?UTF-8?Q?Roger_Pau_Monn=C3=A9?= Date: Thu, 9 Jun 2016 10:03:43 +0200 From: Roger Pau =?iso-8859-1?Q?Monn=E9?= To: Marcin Cieslak Cc: freebsd-xen@FreeBSD.org, xen-devel@lists.xenproject.org, freebsd-virtualization@freebsd.org Subject: Re: HEADS UP: Imported Xen 4.7: no blkback Message-ID: <20160609080343.44rvpda4hskiy3ge@mac> References: <20160603120921.y5l362zgrhf4fdcb@mac> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: User-Agent: Mutt/1.6.0-neo (2016-04-07) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 09 Jun 2016 08:03:50 -0000 On Thu, Jun 09, 2016 at 12:16:59AM +0000, Marcin Cieslak wrote: > On Fri, 3 Jun 2016, Roger Pau Monné wrote: > > > One of the more relevant changes in 4.7 regarding FreeBSD is the support for > > block hotplug scripts. This means that we now have the option to use > > backends different than simple block or regular files, provided that someone > > writes the proper hotplug scripts to attach them (I've heard there are some > > iSCSI hotplug scripts around). This however requires changes in blkback, so > > if you plan to use the Xen 4.7 port, please make sure that you are running a > > kernel that contains revision r301269 (or any later version). The same also > > I am running it with r301685 and the HVM guests have some trouble with > block devices. > > SeaBIOS does not find /dev/zvol/zroot/freebsd1,raw,xvda,w to boot FreeBSD > from, after chaging to "hda" I get up to the kernel mountroot prompt > (Xen block devices seem to be detected in dmesg). Yes, this is intentional, see: https://marc.info/?l=xen-devel&m=144482080812353 Have you checked if you need to change your /etc/fstab to correctly point to the new device? Does FreeBSD correctly list the disk(s) at the mountroot prompt when issuing a "?" command? Also, can you paste the output of `xenstore-ls -fp` from Dom0 when this happens? > What used to be Windows 2016 domU with /dev/zvol/zroot/windows0,raw,hda,w > ends up in the Tianocore UEFI shell. Block devices seem to be available, > I can even list the fs0: partition, but no booting further possible. Hm, I've never used Tianocore myself, so I'm not sure what the issue could be here. Again, can you post the output of `xenstore-ls -fp` from Dom0 when this happens? At least this will show if the PV block device has been correctly attached. Roger. From owner-freebsd-virtualization@freebsd.org Thu Jun 9 09:08:32 2016 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 91FA8AEE10B; Thu, 9 Jun 2016 09:08:32 +0000 (UTC) (envelope-from prvs=9619a384d=wei.liu2@citrix.com) Received: from SMTP.CITRIX.COM (smtp.citrix.com [66.165.176.89]) (using TLSv1.2 with cipher RC4-SHA (128/128 bits)) (Client CN "mail.citrix.com", Issuer "Verizon Public SureServer CA G14-SHA2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 2F2801C83; Thu, 9 Jun 2016 09:08:31 +0000 (UTC) (envelope-from prvs=9619a384d=wei.liu2@citrix.com) X-IronPort-AV: E=Sophos;i="5.26,443,1459814400"; d="scan'208";a="359377564" Date: Thu, 9 Jun 2016 10:07:14 +0100 From: Wei Liu To: Roger Pau =?iso-8859-1?Q?Monn=E9?= CC: Marcin Cieslak , , , , "Wei Liu" Subject: Re: [Xen-devel] HEADS UP: Imported Xen 4.7: no blkback Message-ID: <20160609090714.GA24655@citrix.com> References: <20160603120921.y5l362zgrhf4fdcb@mac> <20160609080343.44rvpda4hskiy3ge@mac> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <20160609080343.44rvpda4hskiy3ge@mac> User-Agent: Mutt/1.5.23 (2014-03-12) X-DLP: MIA2 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 09 Jun 2016 09:08:32 -0000 On Thu, Jun 09, 2016 at 10:03:43AM +0200, Roger Pau Monné wrote: > On Thu, Jun 09, 2016 at 12:16:59AM +0000, Marcin Cieslak wrote: > > On Fri, 3 Jun 2016, Roger Pau Monné wrote: > > > > > One of the more relevant changes in 4.7 regarding FreeBSD is the support for > > > block hotplug scripts. This means that we now have the option to use > > > backends different than simple block or regular files, provided that someone > > > writes the proper hotplug scripts to attach them (I've heard there are some > > > iSCSI hotplug scripts around). This however requires changes in blkback, so > > > if you plan to use the Xen 4.7 port, please make sure that you are running a > > > kernel that contains revision r301269 (or any later version). The same also > > > > I am running it with r301685 and the HVM guests have some trouble with > > block devices. > > > > SeaBIOS does not find /dev/zvol/zroot/freebsd1,raw,xvda,w to boot FreeBSD > > from, after chaging to "hda" I get up to the kernel mountroot prompt > > (Xen block devices seem to be detected in dmesg). > > Yes, this is intentional, see: > > https://marc.info/?l=xen-devel&m=144482080812353 > Note that I reverted that change yesterday. 4.7 will behave as before. Wei. From owner-freebsd-virtualization@freebsd.org Fri Jun 10 21:39:04 2016 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5345EAEF1DE; Fri, 10 Jun 2016 21:39:04 +0000 (UTC) (envelope-from saper@saper.info) Received: from m.saper.info (m.saper.info [IPv6:2a01:4f8:a0:7383::]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "m.saper.info", Issuer "Marcin Cieslak 2016" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id C8CD0279C; Fri, 10 Jun 2016 21:39:03 +0000 (UTC) (envelope-from saper@saper.info) Received: from m.saper.info (saper@m.saper.info [IPv6:2a01:4f8:a0:7383::]) by m.saper.info (8.15.2/8.15.2) with ESMTPS id u5ALd10X089279 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Fri, 10 Jun 2016 21:39:01 GMT (envelope-from saper@saper.info) Received: from localhost (saper@localhost) by m.saper.info (8.15.2/8.15.2/Submit) with ESMTP id u5ALcxRw089276; Fri, 10 Jun 2016 21:39:00 GMT (envelope-from saper@saper.info) X-Authentication-Warning: m.saper.info: saper owned process doing -bs Date: Fri, 10 Jun 2016 21:38:59 +0000 From: Marcin Cieslak To: =?ISO-8859-15?Q?Roger_Pau_Monn=E9?= cc: freebsd-xen@FreeBSD.org, xen-devel@lists.xenproject.org, freebsd-virtualization@freebsd.org Subject: Re: HEADS UP: Imported Xen 4.7: no blkback In-Reply-To: <20160609080343.44rvpda4hskiy3ge@mac> Message-ID: References: <20160603120921.y5l362zgrhf4fdcb@mac> <20160609080343.44rvpda4hskiy3ge@mac> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=iso-8859-1 Content-Transfer-Encoding: 8BIT X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Jun 2016 21:39:04 -0000 On Thu, 9 Jun 2016, Roger Pau Monné wrote: > On Thu, Jun 09, 2016 at 12:16:59AM +0000, Marcin Cieslak wrote: > > On Fri, 3 Jun 2016, Roger Pau Monné wrote: > > > > > One of the more relevant changes in 4.7 regarding FreeBSD is the support for > > > block hotplug scripts. This means that we now have the option to use > > > backends different than simple block or regular files, provided that someone > > > writes the proper hotplug scripts to attach them (I've heard there are some > > > iSCSI hotplug scripts around). This however requires changes in blkback, so > > > if you plan to use the Xen 4.7 port, please make sure that you are running a > > > kernel that contains revision r301269 (or any later version). The same also > > > > I am running it with r301685 and the HVM guests have some trouble with > > block devices. > > > > SeaBIOS does not find /dev/zvol/zroot/freebsd1,raw,xvda,w to boot FreeBSD > > from, after chaging to "hda" I get up to the kernel mountroot prompt > > (Xen block devices seem to be detected in dmesg). > > Yes, this is intentional, see: > > https://marc.info/?l=xen-devel&m=144482080812353 those guests worked fine with 4.5, that's why I am surprised. xbd0 and xbd1 show up in dmesg, mouting root from xbd0p2 fails, but ada0p2 seems to work. I remember that during my previous attempts ZFS ate most of my machine's memory (dom0 was too small I think) and the symptom was very similar if not identical. One thing which struck me is that I was able to fully but one Linux HVM domU. I am also toying with OpenFirmware which boots from floppy as a HVM guest. > Have you checked if you need to change your /etc/fstab to correctly point > to the new device? Does FreeBSD correctly list the disk(s) at the mountroot > prompt when issuing a "?" command? "?" does not work - it mostly causes a panic, the console is slow, but I managed to switch it to /dev/ada0p2, dmesg below: Copyright (c) 1992-2016 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 11.0-CURRENT #1 r298620: Tue Apr 26 13:21:50 UTC 2016 root@o.saper.info:/usr/obj/usr/src/sys/GENERIC amd64 FreeBSD clang version 3.8.0 (tags/RELEASE_380/final 262564) (based on LLVM 3.8.0) WARNING: WITNESS option enabled, expect reduced performance. VT(vga): text 80x25 XEN: Hypervisor version 4.7 detected. CPU: Intel(R) Xeon(R) CPU E31245 @ 3.30GHz (3300.08-MHz K8-class CPU) Origin="GenuineIntel" Id=0x206a7 Family=0x6 Model=0x2a Stepping=7 Features=0x17c3fbff Features2=0x9fba2203 AMD Features=0x28100800 AMD Features2=0x1 XSAVE Features=0x1 Hypervisor: Origin = "XenVMMXenVMM" real memory = 2130706432 (2032 MB) avail memory = 2018213888 (1924 MB) Event timer "LAPIC" quality 400 ACPI APIC Table: WARNING: L1 data cache covers less APIC IDs than a core 0 < 1 WARNING: L2 data cache covers less APIC IDs than a core 0 < 1 WARNING: L3 data cache covers less APIC IDs than a core 0 < 1 FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs FreeBSD/SMP: 1 package(s) x 2 core(s) random: unblocking device. ioapic0: Changing APIC ID to 1 MADT: Forcing active-low polarity and level trigger for SCI ioapic0 irqs 0-47 on motherboard random: entropy device external interface kbd1 at kbdmux0 netmap: loaded module module_register_init: MOD_LOAD (vesa, 0xffffffff80f0ffb0, 0) error 19 vtvga0: on motherboard cryptosoft0: on motherboard acpi0: on motherboard acpi0: Power Button (fixed) acpi0: Sleep Button (fixed) cpu0: on acpi0 cpu1: on acpi0 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 62500000 Hz quality 950 attimer0: port 0x40-0x43 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 atrtc0: port 0x70-0x71 irq 8 on acpi0 Event timer "RTC" frequency 32768 Hz quality 0 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <32-bit timer at 3.579545MHz> port 0xb008-0xb00b on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 isab0: at device 1.0 on pci0 isa0: on isab0 atapci0: port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xc200-0xc20f at device 1.1 on pci0 ata0: at channel 0 on atapci0 ata1: at channel 1 on atapci0 pci0: at device 1.3 (no driver attached) xenpci0: port 0xc000-0xc0ff mem 0xf0000000-0xf0ffffff irq 24 at device 2.0 on pci0 vgapci0: mem 0xf1000000-0xf1ffffff,0xf2050000-0xf2050fff at device 3.0 on pci0 vgapci0: Boot video device atkbdc0: port 0x60,0x64 irq 1 on acpi0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] psm0: irq 12 on atkbdc0 psm0: [GIANT-LOCKED] psm0: model IntelliMouse Explorer, device ID 4 fdc0: port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0 fdc0: does not respond device_attach: fdc0 attach returned 6 xenpv0: on motherboard granttable0: on xenpv0 xen_et0: on xenpv0 Event timer "XENTIMER" frequency 1000000000 Hz quality 950 Timecounter "XENTIMER" frequency 1000000000 Hz quality 950 xenstore0: on xenpv0 evtchn0: on xenpv0 privcmd0: on xenpv0 debug0: on xenpv0 orm0: at iomem 0xed800-0xeffff on isa0 vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 fdc0: No FDOUT register! ppc0: cannot reserve I/O port range Timecounters tick every 1.000 msec xenballoon0: on xenstore0 xctrl0: on xenstore0 xs_dev0: on xenstore0 xenbusb_front0: on xenstore0 xenbusb_add_device: Device device/suspend/event-channel ignored. State 6 xn0: at device/vif/0 on xenbusb_front0 xbd0: 16384MB at device/vbd/768 on xenbusb_front0 xbd0: attaching as ada0 xbd0: features: flush, write_barrier xbd0: synchronize cache commands enabled. xn0: Ethernet address: 00:02:04:08:fd:f0 xenbusb_back0: on xenstore0 xbd1: 40960MB at device/vbd/832 on xenbusb_front0 xbd1: attaching as ada1 xbd1: features: flush, write_barrier xbd1: synchronize cache commands enabled. xn0: backend features: feature-sg SMP: AP CPU #1 Launched! WARNING: WITNESS option enabled, expect reduced performance. Trying to mount root from ufs:/dev/xbd0p2 [rw]... mountroot: waiting for device /dev/xbd0p2... Mounting from ufs:/dev/xbd0p2 failed with error 19. Loader variables: vfs.root.mountfrom=ufs:/dev/xbd0p2 vfs.root.mountfrom.options=rw Manual root filesystem specification: : [options] Mount using filesystem and with the specified (optional) option list. eg. ufs:/dev/da0s1a zfs:tank cd9660:/dev/cd0 ro (which is equivalent to: mount -t cd9660 -o ro /dev/cd0 /) ? List valid disk boot devices . Yield 1 second (for background tasks) Abort manual input mountroot> Trying to mount root from ufs:/dev/ada0p2 []... xn0: link state changed to DOWN xn0: link state changed to UP > Also, can you paste the output of `xenstore-ls -fp` from Dom0 when this > happens? Windows: /tool = "" (n0) /tool/xenstored = "" (n0) /vm = "" (n0) /vm/744e8146-2e7b-11e6-80cd-5404a6685907 = "" (n0,r279) /vm/744e8146-2e7b-11e6-80cd-5404a6685907/name = "Windows2016" (n0,r279) /vm/744e8146-2e7b-11e6-80cd-5404a6685907/uuid = "744e8146-2e7b-11e6-80cd-5404a6685907" (n0,r279) /vm/744e8146-2e7b-11e6-80cd-5404a6685907/rtc = "" (n0,r279) /vm/744e8146-2e7b-11e6-80cd-5404a6685907/rtc/timeoffset = "" (n0,r279) /vm/744e8146-2e7b-11e6-80cd-5404a6685907/image = "" (n0,r279) /vm/744e8146-2e7b-11e6-80cd-5404a6685907/image/ostype = "hvm" (n0,r279) /vm/744e8146-2e7b-11e6-80cd-5404a6685907/start_time = "1465501844.89" (n0,r279) /libxl = "" (n0) /libxl/279 = "" (n0) /libxl/279/dm-version = "qemu_xen" (n0) /local = "" (n0) /local/domain = "" (n0) /local/domain/0 = "" (n0) /local/domain/0/domid = "0" (n0) /local/domain/0/name = "Domain-0" (n0) /local/domain/0/device-model = "" (n0) /local/domain/0/device-model/279 = "" (n0) /local/domain/0/device-model/279/state = "running" (n0) /local/domain/0/device-model/279/physmap = "" (n0) /local/domain/0/device-model/279/physmap/10f000000 = "" (n0) /local/domain/0/device-model/279/physmap/10f000000/start_addr = "f1000000" (n0) /local/domain/0/device-model/279/physmap/10f000000/size = "1000000" (n0) /local/domain/0/device-model/279/physmap/10f000000/name = "vga.vram" (n0) /local/domain/0/backend = "" (n0) /local/domain/0/backend/vbd = "" (n0) /local/domain/0/backend/vbd/279 = "" (n0) /local/domain/0/backend/vbd/279/768 = "" (n0,r279) /local/domain/0/backend/vbd/279/768/frontend = "/local/domain/279/device/vbd/768" (n0,r279) /local/domain/0/backend/vbd/279/768/params = "/dev/zvol/zroot/windows0" (n0,r279) /local/domain/0/backend/vbd/279/768/script = "/usr/local/etc/xen/scripts/block" (n0,r279) /local/domain/0/backend/vbd/279/768/frontend-id = "279" (n0,r279) /local/domain/0/backend/vbd/279/768/online = "1" (n0,r279) /local/domain/0/backend/vbd/279/768/removable = "0" (n0,r279) /local/domain/0/backend/vbd/279/768/bootable = "1" (n0,r279) /local/domain/0/backend/vbd/279/768/state = "3" (n0,r279) /local/domain/0/backend/vbd/279/768/dev = "hda" (n0,r279) /local/domain/0/backend/vbd/279/768/type = "phy" (n0,r279) /local/domain/0/backend/vbd/279/768/mode = "w" (n0,r279) /local/domain/0/backend/vbd/279/768/device-type = "disk" (n0,r279) /local/domain/0/backend/vbd/279/768/discard-enable = "1" (n0,r279) /local/domain/0/backend/vbd/279/768/feature-barrier = "1" (n0,r279) /local/domain/0/backend/vbd/279/768/feature-flush-cache = "1" (n0,r279) /local/domain/0/backend/vbd/279/768/max-ring-page-order = "5" (n0,r279) /local/domain/0/backend/vbd/279/768/physical-device-path = "/dev/zvol/zroot/windows0" (n0,r279) /local/domain/0/backend/vbd/279/768/hotplug-status = "connected" (n0,r279) /local/domain/0/backend/vbd/279/832 = "" (n0,r279) /local/domain/0/backend/vbd/279/832/frontend = "/local/domain/279/device/vbd/832" (n0,r279) /local/domain/0/backend/vbd/279/832/params = "/dev/zvol/zroot/vs2013" (n0,r279) /local/domain/0/backend/vbd/279/832/script = "/usr/local/etc/xen/scripts/block" (n0,r279) /local/domain/0/backend/vbd/279/832/frontend-id = "279" (n0,r279) /local/domain/0/backend/vbd/279/832/online = "1" (n0,r279) /local/domain/0/backend/vbd/279/832/removable = "0" (n0,r279) /local/domain/0/backend/vbd/279/832/bootable = "1" (n0,r279) /local/domain/0/backend/vbd/279/832/state = "3" (n0,r279) /local/domain/0/backend/vbd/279/832/dev = "hdb" (n0,r279) /local/domain/0/backend/vbd/279/832/type = "phy" (n0,r279) /local/domain/0/backend/vbd/279/832/mode = "w" (n0,r279) /local/domain/0/backend/vbd/279/832/device-type = "disk" (n0,r279) /local/domain/0/backend/vbd/279/832/discard-enable = "1" (n0,r279) /local/domain/0/backend/vbd/279/832/feature-barrier = "1" (n0,r279) /local/domain/0/backend/vbd/279/832/feature-flush-cache = "1" (n0,r279) /local/domain/0/backend/vbd/279/832/max-ring-page-order = "5" (n0,r279) /local/domain/0/backend/vbd/279/832/physical-device-path = "/dev/zvol/zroot/vs2013" (n0,r279) /local/domain/0/backend/vbd/279/832/hotplug-status = "connected" (n0,r279) /local/domain/0/backend/console = "" (n0) /local/domain/0/backend/console/279 = "" (n0) /local/domain/0/backend/console/279/0 = "" (n0,r279) /local/domain/0/backend/console/279/0/frontend = "/local/domain/279/console" (n0,r279) /local/domain/0/backend/console/279/0/frontend-id = "279" (n0,r279) /local/domain/0/backend/console/279/0/online = "1" (n0,r279) /local/domain/0/backend/console/279/0/state = "1" (n0,r279) /local/domain/0/backend/console/279/0/protocol = "vt100" (n0,r279) /local/domain/0/backend/vkbd = "" (n0) /local/domain/0/backend/vkbd/279 = "" (n0) /local/domain/0/backend/vkbd/279/0 = "" (n0,r279) /local/domain/0/backend/vkbd/279/0/frontend = "/local/domain/279/device/vkbd/0" (n0,r279) /local/domain/0/backend/vkbd/279/0/frontend-id = "279" (n0,r279) /local/domain/0/backend/vkbd/279/0/online = "1" (n0,r279) /local/domain/0/backend/vkbd/279/0/state = "2" (n0,r279) /local/domain/0/backend/vkbd/279/0/feature-abs-pointer = "1" (n0,r279) /local/domain/0/backend/vkbd/279/0/hotplug-status = "connected" (n0,r279) /local/domain/0/backend/vif = "" (n0) /local/domain/0/backend/vif/279 = "" (n0) /local/domain/0/backend/vif/279/0 = "" (n0,r279) /local/domain/0/backend/vif/279/0/frontend = "/local/domain/279/device/vif/0" (n0,r279) /local/domain/0/backend/vif/279/0/frontend-id = "279" (n0,r279) /local/domain/0/backend/vif/279/0/online = "1" (n0,r279) /local/domain/0/backend/vif/279/0/state = "2" (n0,r279) /local/domain/0/backend/vif/279/0/script = "/usr/local/etc/xen/scripts/vif-bridge" (n0,r279) /local/domain/0/backend/vif/279/0/mac = "00:16:3e:5d:0d:48" (n0,r279) /local/domain/0/backend/vif/279/0/bridge = "bridge0" (n0,r279) /local/domain/0/backend/vif/279/0/handle = "0" (n0,r279) /local/domain/0/backend/vif/279/0/type = "vif_ioemu" (n0,r279) /local/domain/0/backend/vif/279/0/hotplug-status = "connected" (n0,r279) /local/domain/0/backend/vif/279/0/feature-sg = "1" (n0,r279) /local/domain/0/backend/vif/279/0/feature-gso-tcpv4 = "0" (n0,r279) /local/domain/0/backend/vif/279/0/feature-rx-copy = "1" (n0,r279) /local/domain/0/backend/vif/279/0/feature-rx-flip = "0" (n0,r279) /local/domain/279 = "" (n0,r279) /local/domain/279/vm = "/vm/744e8146-2e7b-11e6-80cd-5404a6685907" (n0,r279) /local/domain/279/name = "Windows2016" (n0,r279) /local/domain/279/cpu = "" (n0,r279) /local/domain/279/cpu/0 = "" (n0,r279) /local/domain/279/cpu/0/availability = "online" (n0,r279) /local/domain/279/cpu/1 = "" (n0,r279) /local/domain/279/cpu/1/availability = "online" (n0,r279) /local/domain/279/memory = "" (n0,r279) /local/domain/279/memory/static-max = "4194304" (n0,r279) /local/domain/279/memory/target = "4177920" (n0,r279) /local/domain/279/memory/videoram = "16384" (n0,r279) /local/domain/279/device = "" (n0,r279) /local/domain/279/device/suspend = "" (n0,r279) /local/domain/279/device/suspend/event-channel = "" (n279) /local/domain/279/device/vbd = "" (n0,r279) /local/domain/279/device/vbd/768 = "" (n279,r0) /local/domain/279/device/vbd/768/backend = "/local/domain/0/backend/vbd/279/768" (n279,r0) /local/domain/279/device/vbd/768/backend-id = "0" (n279,r0) /local/domain/279/device/vbd/768/state = "1" (n279,r0) /local/domain/279/device/vbd/768/virtual-device = "768" (n279,r0) /local/domain/279/device/vbd/768/device-type = "disk" (n279,r0) /local/domain/279/device/vbd/832 = "" (n279,r0) /local/domain/279/device/vbd/832/backend = "/local/domain/0/backend/vbd/279/832" (n279,r0) /local/domain/279/device/vbd/832/backend-id = "0" (n279,r0) /local/domain/279/device/vbd/832/state = "1" (n279,r0) /local/domain/279/device/vbd/832/virtual-device = "832" (n279,r0) /local/domain/279/device/vbd/832/device-type = "disk" (n279,r0) /local/domain/279/device/vkbd = "" (n0,r279) /local/domain/279/device/vkbd/0 = "" (n279,r0) /local/domain/279/device/vkbd/0/backend = "/local/domain/0/backend/vkbd/279/0" (n279,r0) /local/domain/279/device/vkbd/0/backend-id = "0" (n279,r0) /local/domain/279/device/vkbd/0/state = "1" (n279,r0) /local/domain/279/device/vif = "" (n0,r279) /local/domain/279/device/vif/0 = "" (n279,r0) /local/domain/279/device/vif/0/backend = "/local/domain/0/backend/vif/279/0" (n279,r0) /local/domain/279/device/vif/0/backend-id = "0" (n279,r0) /local/domain/279/device/vif/0/state = "1" (n279,r0) /local/domain/279/device/vif/0/handle = "0" (n279,r0) /local/domain/279/device/vif/0/mac = "00:16:3e:5d:0d:48" (n279,r0) /local/domain/279/control = "" (n0,r279) /local/domain/279/control/shutdown = "" (n279) /local/domain/279/control/platform-feature-multiprocessor-suspend = "1" (n0,r279) /local/domain/279/control/platform-feature-xs_reset_watches = "1" (n0,r279) /local/domain/279/hvmloader = "" (n0,r279) /local/domain/279/hvmloader/bios = "ovmf" (n0,r279) /local/domain/279/hvmloader/allow-memory-relocate = "0" (n0,r279) /local/domain/279/data = "" (n279) /local/domain/279/drivers = "" (n279) /local/domain/279/feature = "" (n279) /local/domain/279/attr = "" (n279) /local/domain/279/domid = "279" (n0,r279) /local/domain/279/store = "" (n0,r279) /local/domain/279/store/port = "1" (n0,r279) /local/domain/279/store/ring-ref = "1044476" (n0,r279) /local/domain/279/platform = "" (n0,r279) /local/domain/279/platform/acpi = "1" (n0,r279) /local/domain/279/platform/acpi_s3 = "1" (n0,r279) /local/domain/279/platform/acpi_s4 = "1" (n0,r279) /local/domain/279/console = "" (n0,r279) /local/domain/279/console/backend = "/local/domain/0/backend/console/279/0" (n0,r279) /local/domain/279/console/backend-id = "0" (n279,r0) /local/domain/279/console/limit = "1048576" (n0,r279) /local/domain/279/console/type = "xenconsoled" (n0,r279) /local/domain/279/console/output = "pty" (n0,r279) /local/domain/279/console/tty = "/dev/pts/1" (n0,r279) /local/domain/279/console/port = "2" (n0,r279) /local/domain/279/console/ring-ref = "1044479" (n0,r279) /local/domain/279/console/vnc-listen = "127.0.0.1" (n0,r279) /local/domain/279/console/vnc-port = "5900" (n0,r279) /local/domain/279/image = "" (n0,r279) /local/domain/279/image/device-model-pid = "78745" (n0,r279) FreeBSD: /tool = "" (n0) /tool/xenstored = "" (n0) /vm = "" (n0) /vm/faefcbb0-2e7b-11e6-80cd-5404a6685907 = "" (n0,r281) /vm/faefcbb0-2e7b-11e6-80cd-5404a6685907/name = "FreeBSD" (n0,r281) /vm/faefcbb0-2e7b-11e6-80cd-5404a6685907/uuid = "faefcbb0-2e7b-11e6-80cd-5404a6685907" (n0,r281) /vm/faefcbb0-2e7b-11e6-80cd-5404a6685907/rtc = "" (n0,r281) /vm/faefcbb0-2e7b-11e6-80cd-5404a6685907/rtc/timeoffset = "" (n0,r281) /vm/faefcbb0-2e7b-11e6-80cd-5404a6685907/image = "" (n0,r281) /vm/faefcbb0-2e7b-11e6-80cd-5404a6685907/image/ostype = "hvm" (n0,r281) /vm/faefcbb0-2e7b-11e6-80cd-5404a6685907/start_time = "1465502070.75" (n0,r281) /vm/7bbb396a-2f43-11e6-8abe-5404a6685907 = "" (n0,r11) /vm/7bbb396a-2f43-11e6-8abe-5404a6685907/name = "FreeBSD" (n0,r11) /vm/7bbb396a-2f43-11e6-8abe-5404a6685907/uuid = "7bbb396a-2f43-11e6-8abe-5404a6685907" (n0,r11) /vm/7bbb396a-2f43-11e6-8abe-5404a6685907/rtc = "" (n0,r11) /vm/7bbb396a-2f43-11e6-8abe-5404a6685907/rtc/timeoffset = "" (n0,r11) /vm/7bbb396a-2f43-11e6-8abe-5404a6685907/image = "" (n0,r11) /vm/7bbb396a-2f43-11e6-8abe-5404a6685907/image/ostype = "hvm" (n0,r11) /vm/7bbb396a-2f43-11e6-8abe-5404a6685907/start_time = "1465587756.69" (n0,r11) /libxl = "" (n0) /libxl/281 = "" (n0) /libxl/281/dm-version = "qemu_xen" (n0) /libxl/11 = "" (n0) /libxl/11/dm-version = "qemu_xen" (n0) /local = "" (n0) /local/domain = "" (n0) /local/domain/0 = "" (n0) /local/domain/0/domid = "0" (n0) /local/domain/0/name = "Domain-0" (n0) /local/domain/0/device-model = "" (n0) /local/domain/0/device-model/11 = "" (n0) /local/domain/0/device-model/11/state = "running" (n0) /local/domain/0/device-model/11/physmap = "" (n0) /local/domain/0/device-model/11/physmap/7f000000 = "" (n0) /local/domain/0/device-model/11/physmap/7f000000/start_addr = "f1000000" (n0) /local/domain/0/device-model/11/physmap/7f000000/size = "1000000" (n0) /local/domain/0/device-model/11/physmap/7f000000/name = "vga.vram" (n0) /local/domain/0/backend = "" (n0) /local/domain/0/backend/vbd = "" (n0) /local/domain/0/backend/vbd/11 = "" (n0) /local/domain/0/backend/vbd/11/768 = "" (n0,r11) /local/domain/0/backend/vbd/11/768/frontend = "/local/domain/11/device/vbd/768" (n0,r11) /local/domain/0/backend/vbd/11/768/params = "/dev/zvol/zroot/freebsd1" (n0,r11) /local/domain/0/backend/vbd/11/768/script = "/usr/local/etc/xen/scripts/block" (n0,r11) /local/domain/0/backend/vbd/11/768/frontend-id = "11" (n0,r11) /local/domain/0/backend/vbd/11/768/online = "1" (n0,r11) /local/domain/0/backend/vbd/11/768/removable = "0" (n0,r11) /local/domain/0/backend/vbd/11/768/bootable = "1" (n0,r11) /local/domain/0/backend/vbd/11/768/state = "4" (n0,r11) /local/domain/0/backend/vbd/11/768/dev = "hda" (n0,r11) /local/domain/0/backend/vbd/11/768/type = "phy" (n0,r11) /local/domain/0/backend/vbd/11/768/mode = "w" (n0,r11) /local/domain/0/backend/vbd/11/768/device-type = "disk" (n0,r11) /local/domain/0/backend/vbd/11/768/discard-enable = "1" (n0,r11) /local/domain/0/backend/vbd/11/768/feature-barrier = "1" (n0,r11) /local/domain/0/backend/vbd/11/768/feature-flush-cache = "1" (n0,r11) /local/domain/0/backend/vbd/11/768/max-ring-page-order = "5" (n0,r11) /local/domain/0/backend/vbd/11/768/physical-device-path = "/dev/zvol/zroot/freebsd1" (n0,r11) /local/domain/0/backend/vbd/11/768/hotplug-status = "connected" (n0,r11) /local/domain/0/backend/vbd/11/768/sectors = "33554432" (n0,r11) /local/domain/0/backend/vbd/11/768/info = "0" (n0,r11) /local/domain/0/backend/vbd/11/768/sector-size = "512" (n0,r11) /local/domain/0/backend/vbd/11/832 = "" (n0,r11) /local/domain/0/backend/vbd/11/832/frontend = "/local/domain/11/device/vbd/832" (n0,r11) /local/domain/0/backend/vbd/11/832/params = "/dev/zvol/zroot/freebsd2" (n0,r11) /local/domain/0/backend/vbd/11/832/script = "/usr/local/etc/xen/scripts/block" (n0,r11) /local/domain/0/backend/vbd/11/832/frontend-id = "11" (n0,r11) /local/domain/0/backend/vbd/11/832/online = "1" (n0,r11) /local/domain/0/backend/vbd/11/832/removable = "0" (n0,r11) /local/domain/0/backend/vbd/11/832/bootable = "1" (n0,r11) /local/domain/0/backend/vbd/11/832/state = "4" (n0,r11) /local/domain/0/backend/vbd/11/832/dev = "hdb" (n0,r11) /local/domain/0/backend/vbd/11/832/type = "phy" (n0,r11) /local/domain/0/backend/vbd/11/832/mode = "w" (n0,r11) /local/domain/0/backend/vbd/11/832/device-type = "disk" (n0,r11) /local/domain/0/backend/vbd/11/832/discard-enable = "1" (n0,r11) /local/domain/0/backend/vbd/11/832/feature-barrier = "1" (n0,r11) /local/domain/0/backend/vbd/11/832/feature-flush-cache = "1" (n0,r11) /local/domain/0/backend/vbd/11/832/max-ring-page-order = "5" (n0,r11) /local/domain/0/backend/vbd/11/832/physical-device-path = "/dev/zvol/zroot/freebsd2" (n0,r11) /local/domain/0/backend/vbd/11/832/hotplug-status = "connected" (n0,r11) /local/domain/0/backend/vbd/11/832/sectors = "83886080" (n0,r11) /local/domain/0/backend/vbd/11/832/info = "0" (n0,r11) /local/domain/0/backend/vbd/11/832/sector-size = "512" (n0,r11) /local/domain/0/backend/console = "" (n0) /local/domain/0/backend/console/11 = "" (n0) /local/domain/0/backend/console/11/0 = "" (n0,r11) /local/domain/0/backend/console/11/0/frontend = "/local/domain/11/console" (n0,r11) /local/domain/0/backend/console/11/0/frontend-id = "11" (n0,r11) /local/domain/0/backend/console/11/0/online = "1" (n0,r11) /local/domain/0/backend/console/11/0/state = "1" (n0,r11) /local/domain/0/backend/console/11/0/protocol = "vt100" (n0,r11) /local/domain/0/backend/vkbd = "" (n0) /local/domain/0/backend/vkbd/11 = "" (n0) /local/domain/0/backend/vkbd/11/0 = "" (n0,r11) /local/domain/0/backend/vkbd/11/0/frontend = "/local/domain/11/device/vkbd/0" (n0,r11) /local/domain/0/backend/vkbd/11/0/frontend-id = "11" (n0,r11) /local/domain/0/backend/vkbd/11/0/online = "1" (n0,r11) /local/domain/0/backend/vkbd/11/0/state = "2" (n0,r11) /local/domain/0/backend/vkbd/11/0/feature-abs-pointer = "1" (n0,r11) /local/domain/0/backend/vkbd/11/0/hotplug-status = "connected" (n0,r11) /local/domain/0/backend/vif = "" (n0) /local/domain/0/backend/vif/11 = "" (n0) /local/domain/0/backend/vif/11/0 = "" (n0,r11) /local/domain/0/backend/vif/11/0/frontend = "/local/domain/11/device/vif/0" (n0,r11) /local/domain/0/backend/vif/11/0/frontend-id = "11" (n0,r11) /local/domain/0/backend/vif/11/0/online = "1" (n0,r11) /local/domain/0/backend/vif/11/0/state = "4" (n0,r11) /local/domain/0/backend/vif/11/0/script = "/usr/local/etc/xen/scripts/vif-bridge" (n0,r11) /local/domain/0/backend/vif/11/0/mac = "00:02:04:08:fd:f0" (n0,r11) /local/domain/0/backend/vif/11/0/bridge = "bridge0" (n0,r11) /local/domain/0/backend/vif/11/0/handle = "0" (n0,r11) /local/domain/0/backend/vif/11/0/type = "vif_ioemu" (n0,r11) /local/domain/0/backend/vif/11/0/hotplug-status = "connected" (n0,r11) /local/domain/0/backend/vif/11/0/feature-sg = "1" (n0,r11) /local/domain/0/backend/vif/11/0/feature-gso-tcpv4 = "0" (n0,r11) /local/domain/0/backend/vif/11/0/feature-rx-copy = "1" (n0,r11) /local/domain/0/backend/vif/11/0/feature-rx-flip = "0" (n0,r11) /local/domain/11 = "" (n0,r11) /local/domain/11/vm = "/vm/7bbb396a-2f43-11e6-8abe-5404a6685907" (n0,r11) /local/domain/11/name = "FreeBSD" (n0,r11) /local/domain/11/cpu = "" (n0,r11) /local/domain/11/cpu/0 = "" (n0,r11) /local/domain/11/cpu/0/availability = "online" (n0,r11) /local/domain/11/cpu/1 = "" (n0,r11) /local/domain/11/cpu/1/availability = "online" (n0,r11) /local/domain/11/memory = "" (n0,r11) /local/domain/11/memory/static-max = "2097152" (n0,r11) /local/domain/11/memory/target = "2080768" (n0,r11) /local/domain/11/memory/videoram = "16384" (n0,r11) /local/domain/11/device = "" (n0,r11) /local/domain/11/device/suspend = "" (n0,r11) /local/domain/11/device/suspend/event-channel = "" (n11) /local/domain/11/device/vbd = "" (n0,r11) /local/domain/11/device/vbd/768 = "" (n11,r0) /local/domain/11/device/vbd/768/backend = "/local/domain/0/backend/vbd/11/768" (n11,r0) /local/domain/11/device/vbd/768/backend-id = "0" (n11,r0) /local/domain/11/device/vbd/768/state = "4" (n11,r0) /local/domain/11/device/vbd/768/virtual-device = "768" (n11,r0) /local/domain/11/device/vbd/768/device-type = "disk" (n11,r0) /local/domain/11/device/vbd/768/ring-ref0 = "8" (n11,r0) /local/domain/11/device/vbd/768/ring-ref1 = "9" (n11,r0) /local/domain/11/device/vbd/768/ring-ref2 = "10" (n11,r0) /local/domain/11/device/vbd/768/ring-ref3 = "11" (n11,r0) /local/domain/11/device/vbd/768/ring-ref4 = "12" (n11,r0) /local/domain/11/device/vbd/768/ring-ref5 = "13" (n11,r0) /local/domain/11/device/vbd/768/ring-ref6 = "14" (n11,r0) /local/domain/11/device/vbd/768/ring-ref7 = "15" (n11,r0) /local/domain/11/device/vbd/768/ring-ref8 = "16" (n11,r0) /local/domain/11/device/vbd/768/ring-ref9 = "17" (n11,r0) /local/domain/11/device/vbd/768/ring-ref10 = "18" (n11,r0) /local/domain/11/device/vbd/768/ring-ref11 = "19" (n11,r0) /local/domain/11/device/vbd/768/ring-ref12 = "20" (n11,r0) /local/domain/11/device/vbd/768/ring-ref13 = "21" (n11,r0) /local/domain/11/device/vbd/768/ring-ref14 = "22" (n11,r0) /local/domain/11/device/vbd/768/ring-ref15 = "23" (n11,r0) /local/domain/11/device/vbd/768/ring-ref16 = "24" (n11,r0) /local/domain/11/device/vbd/768/ring-ref17 = "25" (n11,r0) /local/domain/11/device/vbd/768/ring-ref18 = "26" (n11,r0) /local/domain/11/device/vbd/768/ring-ref19 = "27" (n11,r0) /local/domain/11/device/vbd/768/ring-ref20 = "28" (n11,r0) /local/domain/11/device/vbd/768/ring-ref21 = "29" (n11,r0) /local/domain/11/device/vbd/768/ring-ref22 = "30" (n11,r0) /local/domain/11/device/vbd/768/ring-ref23 = "31" (n11,r0) /local/domain/11/device/vbd/768/ring-ref24 = "32" (n11,r0) /local/domain/11/device/vbd/768/ring-ref25 = "33" (n11,r0) /local/domain/11/device/vbd/768/ring-ref26 = "34" (n11,r0) /local/domain/11/device/vbd/768/ring-ref27 = "35" (n11,r0) /local/domain/11/device/vbd/768/ring-ref28 = "36" (n11,r0) /local/domain/11/device/vbd/768/ring-ref29 = "37" (n11,r0) /local/domain/11/device/vbd/768/ring-ref30 = "38" (n11,r0) /local/domain/11/device/vbd/768/ring-ref31 = "39" (n11,r0) /local/domain/11/device/vbd/768/num-ring-pages = "32" (n11,r0) /local/domain/11/device/vbd/768/ring-page-order = "5" (n11,r0) /local/domain/11/device/vbd/768/event-channel = "10" (n11,r0) /local/domain/11/device/vbd/768/protocol = "x86_64-abi" (n11,r0) /local/domain/11/device/vbd/832 = "" (n11,r0) /local/domain/11/device/vbd/832/backend = "/local/domain/0/backend/vbd/11/832" (n11,r0) /local/domain/11/device/vbd/832/backend-id = "0" (n11,r0) /local/domain/11/device/vbd/832/state = "4" (n11,r0) /local/domain/11/device/vbd/832/virtual-device = "832" (n11,r0) /local/domain/11/device/vbd/832/device-type = "disk" (n11,r0) /local/domain/11/device/vbd/832/ring-ref0 = "40" (n11,r0) /local/domain/11/device/vbd/832/ring-ref1 = "41" (n11,r0) /local/domain/11/device/vbd/832/ring-ref2 = "42" (n11,r0) /local/domain/11/device/vbd/832/ring-ref3 = "43" (n11,r0) /local/domain/11/device/vbd/832/ring-ref4 = "44" (n11,r0) /local/domain/11/device/vbd/832/ring-ref5 = "45" (n11,r0) /local/domain/11/device/vbd/832/ring-ref6 = "46" (n11,r0) /local/domain/11/device/vbd/832/ring-ref7 = "47" (n11,r0) /local/domain/11/device/vbd/832/ring-ref8 = "48" (n11,r0) /local/domain/11/device/vbd/832/ring-ref9 = "49" (n11,r0) /local/domain/11/device/vbd/832/ring-ref10 = "50" (n11,r0) /local/domain/11/device/vbd/832/ring-ref11 = "51" (n11,r0) /local/domain/11/device/vbd/832/ring-ref12 = "52" (n11,r0) /local/domain/11/device/vbd/832/ring-ref13 = "53" (n11,r0) /local/domain/11/device/vbd/832/ring-ref14 = "54" (n11,r0) /local/domain/11/device/vbd/832/ring-ref15 = "55" (n11,r0) /local/domain/11/device/vbd/832/ring-ref16 = "56" (n11,r0) /local/domain/11/device/vbd/832/ring-ref17 = "57" (n11,r0) /local/domain/11/device/vbd/832/ring-ref18 = "58" (n11,r0) /local/domain/11/device/vbd/832/ring-ref19 = "59" (n11,r0) /local/domain/11/device/vbd/832/ring-ref20 = "60" (n11,r0) /local/domain/11/device/vbd/832/ring-ref21 = "61" (n11,r0) /local/domain/11/device/vbd/832/ring-ref22 = "62" (n11,r0) /local/domain/11/device/vbd/832/ring-ref23 = "63" (n11,r0) /local/domain/11/device/vbd/832/ring-ref24 = "64" (n11,r0) /local/domain/11/device/vbd/832/ring-ref25 = "65" (n11,r0) /local/domain/11/device/vbd/832/ring-ref26 = "66" (n11,r0) /local/domain/11/device/vbd/832/ring-ref27 = "67" (n11,r0) /local/domain/11/device/vbd/832/ring-ref28 = "68" (n11,r0) /local/domain/11/device/vbd/832/ring-ref29 = "69" (n11,r0) /local/domain/11/device/vbd/832/ring-ref30 = "70" (n11,r0) /local/domain/11/device/vbd/832/ring-ref31 = "71" (n11,r0) /local/domain/11/device/vbd/832/num-ring-pages = "32" (n11,r0) /local/domain/11/device/vbd/832/ring-page-order = "5" (n11,r0) /local/domain/11/device/vbd/832/event-channel = "11" (n11,r0) /local/domain/11/device/vbd/832/protocol = "x86_64-abi" (n11,r0) /local/domain/11/device/vkbd = "" (n0,r11) /local/domain/11/device/vkbd/0 = "" (n11,r0) /local/domain/11/device/vkbd/0/backend = "/local/domain/0/backend/vkbd/11/0" (n11,r0) /local/domain/11/device/vkbd/0/backend-id = "0" (n11,r0) /local/domain/11/device/vkbd/0/state = "1" (n11,r0) /local/domain/11/device/vif = "" (n0,r11) /local/domain/11/device/vif/0 = "" (n11,r0) /local/domain/11/device/vif/0/backend = "/local/domain/0/backend/vif/11/0" (n11,r0) /local/domain/11/device/vif/0/backend-id = "0" (n11,r0) /local/domain/11/device/vif/0/state = "4" (n11,r0) /local/domain/11/device/vif/0/handle = "0" (n11,r0) /local/domain/11/device/vif/0/mac = "00:02:04:08:fd:f0" (n11,r0) /local/domain/11/device/vif/0/tx-ring-ref = "768" (n11,r0) /local/domain/11/device/vif/0/rx-ring-ref = "329" (n11,r0) /local/domain/11/device/vif/0/event-channel = "12" (n11,r0) /local/domain/11/device/vif/0/request-rx-copy = "1" (n11,r0) /local/domain/11/device/vif/0/feature-rx-notify = "1" (n11,r0) /local/domain/11/device/vif/0/feature-sg = "1" (n11,r0) /local/domain/11/device/vif/0/feature-gso-tcpv4 = "1" (n11,r0) /local/domain/11/control = "" (n0,r11) /local/domain/11/control/shutdown = "" (n11) /local/domain/11/control/platform-feature-multiprocessor-suspend = "1" (n0,r11) /local/domain/11/control/platform-feature-xs_reset_watches = "1" (n0,r11) /local/domain/11/hvmloader = "" (n0,r11) /local/domain/11/hvmloader/bios = "seabios" (n0,r11) /local/domain/11/hvmloader/allow-memory-relocate = "0" (n0,r11) /local/domain/11/data = "" (n11) /local/domain/11/drivers = "" (n11) /local/domain/11/feature = "" (n11) /local/domain/11/attr = "" (n11) /local/domain/11/domid = "11" (n0,r11) /local/domain/11/store = "" (n0,r11) /local/domain/11/store/port = "1" (n0,r11) /local/domain/11/store/ring-ref = "1044476" (n0,r11) /local/domain/11/platform = "" (n0,r11) /local/domain/11/platform/acpi = "1" (n0,r11) /local/domain/11/platform/acpi_s3 = "1" (n0,r11) /local/domain/11/platform/acpi_s4 = "1" (n0,r11) /local/domain/11/console = "" (n0,r11) /local/domain/11/console/backend = "/local/domain/0/backend/console/11/0" (n0,r11) /local/domain/11/console/backend-id = "0" (n11,r0) /local/domain/11/console/limit = "1048576" (n0,r11) /local/domain/11/console/type = "xenconsoled" (n0,r11) /local/domain/11/console/output = "pty" (n0,r11) /local/domain/11/console/tty = "/dev/pts/1" (n0,r11) /local/domain/11/console/port = "2" (n0,r11) /local/domain/11/console/ring-ref = "1044479" (n0,r11) /local/domain/11/console/vnc-listen = "127.0.0.1" (n0,r11) /local/domain/11/console/vnc-port = "5900" (n0,r11) /local/domain/11/image = "" (n0,r11) /local/domain/11/image/device-model-pid = "6311" (n0,r11) > > What used to be Windows 2016 domU with /dev/zvol/zroot/windows0,raw,hda,w > > ends up in the Tianocore UEFI shell. Block devices seem to be available, > > I can even list the fs0: partition, but no booting further possible. > > Hm, I've never used Tianocore myself, so I'm not sure what the issue could > be here. Again, can you post the output of `xenstore-ls -fp` from Dom0 when > this happens? At least this will show if the PV block device has been > correctly attached. See above. How do I rollback to 4.5.2, do I need to downgrade the FreeBSD kernel as well? Marcin