From owner-freebsd-xen@freebsd.org Sun May 13 13:51:54 2018 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7B301FDDC60 for ; Sun, 13 May 2018 13:51:54 +0000 (UTC) (envelope-from kai_otto@duckster.net) Received: from woodhouse.mariphil-volunteers.com (woodhouse.mariphil-volunteers.com [IPv6:2a03:4000:10:14::dead:beef]) by mx1.freebsd.org (Postfix) with ESMTP id 1659A77D58 for ; Sun, 13 May 2018 13:51:53 +0000 (UTC) (envelope-from kai_otto@duckster.net) Received: from localhost (localhost [127.0.0.1]) by woodhouse.mariphil-volunteers.com (Postfix) with ESMTP id 68D2D404 for ; Sun, 13 May 2018 15:52:06 +0200 (CEST) X-Virus-Scanned: amavisd-new at woodhouse.mariphil-volunteers.com Received: from woodhouse.mariphil-volunteers.com ([127.0.0.1]) by localhost (woodhouse.mariphil-volunteers.com [127.0.0.1]) (amavisd-new, port 10024) with LMTP id y25vzekTqUul for ; Sun, 13 May 2018 15:51:51 +0200 (CEST) Received: from [IPv6:2001:16b8:227e:79c0:c9bf:aad8:891d:4ec0] (200116b8227e79c0c9bfaad8891d4ec0.dip.versatel-1u1.de [IPv6:2001:16b8:227e:79c0:c9bf:aad8:891d:4ec0]) by woodhouse.mariphil-volunteers.com (Postfix) with ESMTPSA id 015BE3BB for ; Sun, 13 May 2018 15:51:50 +0200 (CEST) To: freebsd-xen@freebsd.org From: Kai Otto Subject: Linux domU only works with xen_platform_pci=0 ? Message-ID: Date: Sun, 13 May 2018 15:51:36 +0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.7.0 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 13 May 2018 13:51:54 -0000 Hello, I'm trying to set up a FreeBSD 11.1 system as Xen virtualization host. Following a combination of handbook [1] and wiki [2], I was able to get get a FreeBSD dom0 in PVH mode, and FreeBSD domU in HVM mode running, including installation to disk and networking. It seemed to me as if the switch 'xen_platform_pci' doesn't have an effect on FreeBSD domU's, as I see e.g. a xenpci0 and xbd0 in dmesg no matter if I set it to 1 or 0. Do I understand it correctly, that this switch makes the difference between HVM and PVHVM mode? According to xl.cfg(5), it 'enables a guest Operating System [...] to make use of paravirtualization features such as disk and network devices'. Afterwards, I tried to create a Linux domU. Both Centos 7 and Alpine Linux only detected the harddisk with xen_platform_pci=0. For Alpine Linux, with xen_platform_pci=1, I get the following messages on the console: vbd vbd-5632: 19 xenbus_dev_probe on device/vbd/5632 vbd vbd-5632: failed to write error node for device/vbd/5632 (19 xenbus_dev_probe on device/vbd/5632) After waiting for a couple minutes it boots, but doesn't detect the disk. Looking in /var/log/xen/qemu-dm-alpine-hvm.log, I see the following messages: xen be core: can't open gnttab device xen be core: can't open gnttab device xen be: vkbd-0: initalize() failed xen be: vkbd-0: initalize() failed xen be: vkbd-0: initalize() failed Googling around yielded [3], where someone apparently ran into the same problem, and used xen_platform_pci=0 as workaround. So my question is: Is xen_platform_pci=1 required for PVHVM mode? If yes, is PVHVM mode only available for FreeBSD domU's? If no, how can I enable it for Linux guests? Any response would be appreciated, thanks! (Unrelated: I also couldn't get PVH guests to boot, neither FreeBSD nor Linux. The console stayed blank and CPU went to 100%. But that's a whole other story I guess.) - Kai My system: OS: FreeBSD-11.1-RELEASE amd64 xen installed via pkg Processor: E3-1240 v2, (which supports VT-x, VT-d and EPT) My alpine.cfg: builder="hvm" name="alpine-hvm" memory=1024 vcpus=1 vif = [ 'bridge=bridge0' ] disk = [ '/dev/zvol/zbulk/vm/alpine-hvm_disk0,raw,hda,rw', '/zbulk/mediashare/isos/linux/apline-virt-3.7.0-x86_64.iso,raw,hdb:cdrom,r'] xen_platform_pci=1 # or 0, see above vnc = 1 vnclisten = "0.0.0.0" serial = "pty" usbdevice = "tablet" -- [1] https://www.freebsd.org/doc/en/books/handbook/virtualization-host-xen.html [2] https://wiki.freebsd.org/Xen [3] https://www.reddit.com/r/freebsd/comments/6uldys/freebsd_111_linux_domu_on_xen_wont_boot/ From owner-freebsd-xen@freebsd.org Sun May 13 15:16:59 2018 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id EE985FE1BB2 for ; Sun, 13 May 2018 15:16:58 +0000 (UTC) (envelope-from royger@FreeBSD.org) Received: from smtp.freebsd.org (unknown [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "smtp.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id A2B2883269; Sun, 13 May 2018 15:16:58 +0000 (UTC) (envelope-from royger@FreeBSD.org) Received: from localhost (cpc92722-cmbg20-2-0-cust481.5-4.cable.virginm.net [82.21.85.226]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) (Authenticated sender: royger) by smtp.freebsd.org (Postfix) with ESMTPSA id 365FFE92F; Sun, 13 May 2018 15:16:58 +0000 (UTC) (envelope-from royger@FreeBSD.org) Date: Sun, 13 May 2018 16:16:49 +0100 From: Roger Pau =?utf-8?B?TW9ubsOp?= To: Kai Otto Cc: freebsd-xen@freebsd.org Subject: Re: Linux domU only works with xen_platform_pci=0 ? Message-ID: <20180513151649.4ls73myegkhm3cep@MacBook-Pro-de-Roger.local> References: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: NeoMutt/20180323 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 13 May 2018 15:16:59 -0000 On Sun, May 13, 2018 at 03:51:36PM +0200, Kai Otto wrote: > Hello, > > I'm trying to set up a FreeBSD 11.1 system as Xen virtualization host. > Following a combination of handbook [1] and wiki [2], I was able to get > get a FreeBSD dom0 in PVH mode, and FreeBSD domU in HVM mode running, > including installation to disk and networking. > > It seemed to me as if the switch 'xen_platform_pci' doesn't have an > effect on FreeBSD domU's, as I see e.g. a xenpci0 and xbd0 in dmesg no > matter if I set it to 1 or 0. > > Do I understand it correctly, that this switch makes the difference > between HVM and PVHVM mode? > According to xl.cfg(5), it 'enables a guest Operating System [...] to > make use of paravirtualization features such as disk and network devices'. > > > Afterwards, I tried to create a Linux domU. Both Centos 7 and Alpine > Linux only detected the harddisk with xen_platform_pci=0. > > For Alpine Linux, with xen_platform_pci=1, I get the following messages > on the console: > > vbd vbd-5632: 19 xenbus_dev_probe on device/vbd/5632 That's ENODEV IIRC, I think there's something wrong with FreeBSD disk backend. > vbd vbd-5632: failed to write error node for device/vbd/5632 (19 > xenbus_dev_probe on device/vbd/5632) > > After waiting for a couple minutes it boots, but doesn't detect the disk. > > Looking in /var/log/xen/qemu-dm-alpine-hvm.log, I see the following > messages: > > xen be core: can't open gnttab device > xen be core: can't open gnttab device > xen be: vkbd-0: initalize() failed > xen be: vkbd-0: initalize() failed > xen be: vkbd-0: initalize() failed > > > > Googling around yielded [3], where someone apparently ran into the same > problem, and used xen_platform_pci=0 as workaround. > > > > So my question is: > Is xen_platform_pci=1 required for PVHVM mode? No, it shouldn't be. > If yes, is PVHVM mode only available for FreeBSD domU's? > If no, how can I enable it for Linux guests? If you boot FreeBSD Dom0 kernel with boot_verbose=YES (in /boot/loader.conf), can you paste the messages you get when trying to boot the PVHVM guest with xen_platform_pci=1? Also, can you paste the output of `xenstore-ls -fp` executed on Dom0 after the PVHVM guest has failed to boot but is still running? > Any response would be appreciated, thanks! > > (Unrelated: I also couldn't get PVH guests to boot, neither FreeBSD nor > Linux. The console stayed blank and CPU went to 100%. But that's a whole > other story I guess.) FreeBSD Dom0 runs in PVH mode, so you are indeed able to boot at least one PVH guest :). Let's look into the PVHVM issue first. > My system: > > OS: FreeBSD-11.1-RELEASE amd64 > xen installed via pkg > Processor: E3-1240 v2, (which supports VT-x, VT-d and EPT) > > > My alpine.cfg: > > builder="hvm" > name="alpine-hvm" > memory=1024 > vcpus=1 > vif = [ 'bridge=bridge0' ] > disk = [ '/dev/zvol/zbulk/vm/alpine-hvm_disk0,raw,hda,rw', > '/zbulk/mediashare/isos/linux/apline-virt-3.7.0-x86_64.iso,raw,hdb:cdrom,r'] > > xen_platform_pci=1 # or 0, see above > vnc = 1 > vnclisten = "0.0.0.0" > serial = "pty" > usbdevice = "tablet" Your domain config file seems OK to me. Roger. From owner-freebsd-xen@freebsd.org Sun May 13 17:29:24 2018 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 85A22FC5B7C for ; Sun, 13 May 2018 17:29:24 +0000 (UTC) (envelope-from saper@saper.info) Received: from m.saper.info (m.saper.info [IPv6:2a01:4f8:a0:7383::]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "saper.info", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 187D7771F3; Sun, 13 May 2018 17:29:23 +0000 (UTC) (envelope-from saper@saper.info) Received: from m.saper.info (saper@localhost [127.0.0.1]) by m.saper.info (8.15.2/8.15.2) with ESMTPS id w4DHTKUu078205 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Sun, 13 May 2018 17:29:20 GMT (envelope-from saper@saper.info) Received: from localhost (saper@localhost) by m.saper.info (8.15.2/8.15.2/Submit) with ESMTP id w4DHTK50078202; Sun, 13 May 2018 17:29:20 GMT (envelope-from saper@saper.info) X-Authentication-Warning: m.saper.info: saper owned process doing -bs Date: Sun, 13 May 2018 17:29:19 +0000 From: Marcin Cieslak To: Kai Otto cc: freebsd-xen@freebsd.org, =?ISO-8859-15?Q?Roger_Pau_Monn=E9?= Subject: Re: Linux domU only works with xen_platform_pci=0 ? In-Reply-To: Message-ID: References: MIME-Version: 1.0 Content-Type: multipart/signed; protocol="application/pkcs7-signature"; micalg=sha-256; boundary="1563967779-1269120528-1526232560=:44112" X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 13 May 2018 17:29:24 -0000 --1563967779-1269120528-1526232560=:44112 Content-Type: text/plain; charset=US-ASCII On Sun, 13 May 2018, Kai Otto wrote: > Hello, > > Linux only detected the harddisk with xen_platform_pci=0. > > For Alpine Linux, with xen_platform_pci=1, I get the following messages > on the console: > > vbd vbd-5632: 19 xenbus_dev_probe on device/vbd/5632 > vbd vbd-5632: failed to write error node for device/vbd/5632 (19 > xenbus_dev_probe on device/vbd/5632) I have reported this here, too: https://lists.freebsd.org/pipermail/freebsd-xen/2017-August/003079.html I think it is needed for some newer Linux kernels only. I am successfully using Windows, Solaris and some other wierd HVM guests without this option successfully. xen_platform_pci=1 seems to confuse Linux 4.* line (2.6.32 boots fine). Marcin --1563967779-1269120528-1526232560=:44112 Content-Type: application/pkcs7-signature; name=smime.p7s Content-Transfer-Encoding: BASE64 Content-Description: S/MIME Cryptographic Signature Content-Disposition: attachment; filename=smime.p7s MIIOSwYJKoZIhvcNAQcCoIIOPDCCDjgCAQExDzANBglghkgBZQMEAgEFADAL BgkqhkiG9w0BBwGgggqQMIIElzCCA3+gAwIBAgIOSBtqCKJEiNNcmz3JSA0w DQYJKoZIhvcNAQELBQAwTDEgMB4GA1UECxMXR2xvYmFsU2lnbiBSb290IENB IC0gUjMxEzARBgNVBAoTCkdsb2JhbFNpZ24xEzARBgNVBAMTCkdsb2JhbFNp Z24wHhcNMTYwNjE1MDAwMDAwWhcNMjQwNjE1MDAwMDAwWjBdMQswCQYDVQQG EwJCRTEZMBcGA1UEChMQR2xvYmFsU2lnbiBudi1zYTEzMDEGA1UEAxMqR2xv YmFsU2lnbiBQZXJzb25hbFNpZ24gMSBDQSAtIFNIQTI1NiAtIEczMIIBIjAN BgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAyrCba00KOKyGuwh9h+/MAcZm ZUF9OxGKA56AADHaDE08rB0WEbgm6J4XvJP3OGQ7cgHdVJu6XMZkRd6EcfjD yRrIwE6oAVWJe57co3gKk/XxvuubSZuUahrcOiv3D2qaHwva4zumubxQQI4f unEzRIJHPiNjaq0cCcZsMcp5pxsEz8aG0sr8Oh80sxKNnzPmuUETLESktfMC pQKHUGmWXLsG6sgCZOezUjDjKpPKW7l4PUt0TEBEyqLhifv9/YPn5C4o10PP daDazZPeKNif2PVQ5u0HRnkFrHh4wmmrMtY22Mse3eR01gD6rEEGWf+gdzuy EQE+ZVlNhCP4gXjdBQIDAQABo4IBZDCCAWAwDgYDVR0PAQH/BAQDAgEGMCcG A1UdJQQgMB4GCCsGAQUFBwMCBggrBgEFBQcDBAYIKwYBBQUHAwkwEgYDVR0T AQH/BAgwBgEB/wIBADAdBgNVHQ4EFgQUlifCwqX3HPgCenpkr2NvMtKYwrEw HwYDVR0jBBgwFoAUj/BLf6guRSSuTVD6Y5qL3uLdG7wwPgYIKwYBBQUHAQEE MjAwMC4GCCsGAQUFBzABhiJodHRwOi8vb2NzcDIuZ2xvYmFsc2lnbi5jb20v cm9vdHIzMDYGA1UdHwQvMC0wK6ApoCeGJWh0dHA6Ly9jcmwuZ2xvYmFsc2ln bi5jb20vcm9vdC1yMy5jcmwwWQYDVR0gBFIwUDALBgkrBgEEAaAyASgwQQYJ KwYBBAGgMgFfMDQwMgYIKwYBBQUHAgEWJmh0dHBzOi8vd3d3Lmdsb2JhbHNp Z24uY29tL3JlcG9zaXRvcnkvMA0GCSqGSIb3DQEBCwUAA4IBAQCxh3ekjKKy RrUdfI6D1U7qUggdFLksiU+KiIqJzJG6GXcQ2KiBy2tF3+KYb0IixXMpIVli VXlcD5Vh4tiMxJ4WONMFt3f7/53gSXLf24WMwErubc+mGMzgUGE5HKC98PcK UV/5pPggQdzPxCBNeiXnLU1tCGYhPatFTDhUBGaVhBeuUCbgR9gpXJ9guqrD OVwouKvovdIeI5KEAcoAAiSL6naeLk/GbKUaBFa2RxXC17e+YyBWtWlWDEM3 1V8pUIx76lkO8IJYREhLcg/LnyoYy5wcrzI6pbX2vw1x/jR3GHSC1AEdoqbE xui2XLLlSa6y9yQNgdkPz7GTLmpwIT+dMIIF8TCCBNmgAwIBAgIMGk4Oe/1h 2+wMOby/MA0GCSqGSIb3DQEBCwUAMF0xCzAJBgNVBAYTAkJFMRkwFwYDVQQK ExBHbG9iYWxTaWduIG52LXNhMTMwMQYDVQQDEypHbG9iYWxTaWduIFBlcnNv bmFsU2lnbiAxIENBIC0gU0hBMjU2IC0gRzMwHhcNMTcwNTI1MDg0NDE2WhcN MjAwNTI1MDg0NDE2WjA8MRkwFwYDVQQDDBBzYXBlckBzYXBlci5pbmZvMR8w HQYJKoZIhvcNAQkBFhBzYXBlckBzYXBlci5pbmZvMIICIjANBgkqhkiG9w0B AQEFAAOCAg8AMIICCgKCAgEA2sO3aQNus/oe4ZBZ4fu1Y1mzxnUYAkb4k/dw gMFc2Kd0eRoOY0AHj4rTEi/vVzzizxjLbEwXzQ9cBEAu/PqS8WsOmhZXtlfi szPDmP7ZpOwmNTWKSd9O7jHu9uTCGfEOsocQNYH2ULD1gVFkgKb8jHf+3u9d uCzh6qMomTtwLrCGEP70Lq385xUzRaD6qbOeIB99tpzgvMR6Z0GPTt4z8tLM kfdtohq5llwZ5vYnj/hJohVS9iLMQMHW4nuLj/mLZNaYE1CWJBT1rBwn5YPJ uR6811O9eAP7aX4iG8k1jkiBh+QNgGRBIK4GIdqy7IVRhA7v2OlpLYHMk4zP 9Fs3M+56QromVKBnxfzLhuYMUK6ugj9jwskNVitqlEFUeyfgvmR1jnPRp1Nd XGJllTNwGicR8wkaRj14RxfrvTZfwXs8OBODKFupqun/tNzdpOgyHMGQACss 9yv2SnLGCJvJK3rGIdRZEiUhLZH/Ct4L92dBhev+SjUqWKbHb4yIlGMgLdoh nwqatuWw7iyOeInjcinX7ghiIKDWhulUN493Fzl6kaUBtIIcrb7jzZ2pHAQT WUmuVnCTHk6NtoWB09lvuK77fw4GfxLWDFWkBQiJYPVBrmxlrkCKzrWdTMfS W9BiEC10jT1sSimUBIjDz22RkfsApeBJoAIWjiOZogILu9MCAwEAAaOCAdAw ggHMMA4GA1UdDwEB/wQEAwIFoDCBngYIKwYBBQUHAQEEgZEwgY4wTQYIKwYB BQUHMAKGQWh0dHA6Ly9zZWN1cmUuZ2xvYmFsc2lnbi5jb20vY2FjZXJ0L2dz cGVyc29uYWxzaWduMXNoYTJnM29jc3AuY3J0MD0GCCsGAQUFBzABhjFodHRw Oi8vb2NzcDIuZ2xvYmFsc2lnbi5jb20vZ3NwZXJzb25hbHNpZ24xc2hhMmcz MEwGA1UdIARFMEMwQQYJKwYBBAGgMgEoMDQwMgYIKwYBBQUHAgEWJmh0dHBz Oi8vd3d3Lmdsb2JhbHNpZ24uY29tL3JlcG9zaXRvcnkvMAkGA1UdEwQCMAAw RAYDVR0fBD0wOzA5oDegNYYzaHR0cDovL2NybC5nbG9iYWxzaWduLmNvbS9n c3BlcnNvbmFsc2lnbjFzaGEyZzMuY3JsMBsGA1UdEQQUMBKBEHNhcGVyQHNh cGVyLmluZm8wHQYDVR0lBBYwFAYIKwYBBQUHAwIGCCsGAQUFBwMEMB0GA1Ud DgQWBBReBINaGUKUo7HCrIjsKLKERu6ooTAfBgNVHSMEGDAWgBSWJ8LCpfcc +AJ6emSvY28y0pjCsTANBgkqhkiG9w0BAQsFAAOCAQEAC0VK968ySq/6B+Kd ecjVThQOKtVXuG17Krfk0xz7OPYR/V+qZtBFm2Uc6tkUEmAmq3Tyf+SE3TTX Q58eJFq0uCTUhIY714ioJs1uVWBz8rPyJ3swkOfDaUXUxkQsBsf73VfKjUk4 kB5MTrApLYUe35NmEY3FqyyX13elhW1tp864vOKM2Git61cYoRn/bwd/z2JM Zkxwkd5JgvmM+p4Da+WO4CUsGzdrZEH8X/8NQIzWtUDIh7VEQZFX5fot/KvH Am8AajtpmNqTfMyg6LfcfJUXSFqXn/KEWu4Td62vX6Pd70dYKUZxnLwYvGqG A4Ktrp9zyrUzxLbmdaPln7CstjGCA38wggN7AgEBMG0wXTELMAkGA1UEBhMC QkUxGTAXBgNVBAoTEEdsb2JhbFNpZ24gbnYtc2ExMzAxBgNVBAMTKkdsb2Jh bFNpZ24gUGVyc29uYWxTaWduIDEgQ0EgLSBTSEEyNTYgLSBHMwIMGk4Oe/1h 2+wMOby/MA0GCWCGSAFlAwQCAQUAoIHkMBgGCSqGSIb3DQEJAzELBgkqhkiG 9w0BBwEwHAYJKoZIhvcNAQkFMQ8XDTE4MDUxMzE3MjkyMFowLwYJKoZIhvcN AQkEMSIEIABA+wOV3k8rzsIuNPHzCksNwpRkSQGeUTa1zIv8SdecMHkGCSqG SIb3DQEJDzFsMGowCwYJYIZIAWUDBAEqMAsGCWCGSAFlAwQBFjALBglghkgB ZQMEAQIwCgYIKoZIhvcNAwcwDgYIKoZIhvcNAwICAgCAMA0GCCqGSIb3DQMC AgFAMAcGBSsOAwIHMA0GCCqGSIb3DQMCAgEoMA0GCSqGSIb3DQEBAQUABIIC AA4eEpACK5Y7qcTnJdzfl/hYAYrmK+uNeRXo61AFLuE4QKDIve54xwtnPUpB ox3fGYe6LfuzG65IV9YTmipoZvtbonIcLz65rKsOn838hRYfaqGcSpyJV1rp ACL4t5qD2rUgvTiXOK4EubuyMPRW7w5Z0oNKM3WPFpdwk87azTqo+dcRG+Vp E1uCyj1XHKa58/tyZt7+FkWbAlFh88cr7XgtulE0B7QS84Uiw1cFoxmnu59P BeZv074QgZp8UK8tHeBM8U+S5BuJ+pP8X2VuS9fHANJypKbCgRJUeAW+d2Tp JRso5mB4Tkwv6sJ/6N6pZXyIqaaEJg9gb8a6BdQbXufTtfCGwd6FpPwuW5uj tSqEhZgLXgIL7JiKsrehsTEoblcYEVvO3RM20AWMqOjpMlpCVQBZVl7Nk5xx nmPZRRuEBK17OVO1Fpy33PquAlCcZbQWTaIjQKoKVUrtLwr7lNG0SxnDqCuN GyG9SiBwcWq9eCIWPDfeY/+4aCv/m0vsKKR+5LIf/haNZaF8wUd0MFoJ1CrI H8ih1Webvm/CGEErN6JCbOojxN+9Lfb4fHxeW8ydEhDOR/ooxT8c9aNA8rI3 WRpgVwzhOEoxnqNFoiMAiVZL6wjNfD4FupGSgdN3BDcYXimN20rNxAlYqYKV cP0hKSp0Rbd5BJRSVMrbzUw0 --1563967779-1269120528-1526232560=:44112-- From owner-freebsd-xen@freebsd.org Sun May 13 17:33:28 2018 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 15FD8FC704C for ; Sun, 13 May 2018 17:33:28 +0000 (UTC) (envelope-from kai_otto@duckster.net) Received: from woodhouse.mariphil-volunteers.com (woodhouse.mariphil-volunteers.com [IPv6:2a03:4000:10:14::dead:beef]) by mx1.freebsd.org (Postfix) with ESMTP id 86C6E78A1F; Sun, 13 May 2018 17:33:27 +0000 (UTC) (envelope-from kai_otto@duckster.net) Received: from localhost (localhost [127.0.0.1]) by woodhouse.mariphil-volunteers.com (Postfix) with ESMTP id AF342404; Sun, 13 May 2018 19:33:34 +0200 (CEST) X-Virus-Scanned: amavisd-new at woodhouse.mariphil-volunteers.com Received: from woodhouse.mariphil-volunteers.com ([127.0.0.1]) by localhost (woodhouse.mariphil-volunteers.com [127.0.0.1]) (amavisd-new, port 10024) with LMTP id P55OHTzRiqzm; Sun, 13 May 2018 19:33:18 +0200 (CEST) Received: from [IPv6:2001:16b8:227e:79c0:f863:a5a3:18b1:f57c] (200116b8227e79c0f863a5a318b1f57c.dip.versatel-1u1.de [IPv6:2001:16b8:227e:79c0:f863:a5a3:18b1:f57c]) by woodhouse.mariphil-volunteers.com (Postfix) with ESMTPSA id 6180D3F2; Sun, 13 May 2018 19:33:18 +0200 (CEST) Subject: Re: Linux domU only works with xen_platform_pci=0 ? To: =?UTF-8?Q?Roger_Pau_Monn=c3=a9?= Cc: freebsd-xen@freebsd.org References: <20180513151649.4ls73myegkhm3cep@MacBook-Pro-de-Roger.local> From: Kai Otto Message-ID: <0749df4b-1614-dcdf-1bf2-1bbad1ae5743@duckster.net> Date: Sun, 13 May 2018 19:33:03 +0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.7.0 MIME-Version: 1.0 In-Reply-To: <20180513151649.4ls73myegkhm3cep@MacBook-Pro-de-Roger.local> Content-Type: multipart/mixed; boundary="------------D8AD9E49249F0A938B795047" Content-Language: en-US X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 13 May 2018 17:33:28 -0000 This is a multi-part message in MIME format. --------------D8AD9E49249F0A938B795047 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit On 13/05/18 17:16, Roger Pau Monné wrote: > On Sun, May 13, 2018 at 03:51:36PM +0200, Kai Otto wrote: >> Hello, >> >> I'm trying to set up a FreeBSD 11.1 system as Xen virtualization host. >> Following a combination of handbook [1] and wiki [2], I was able to get >> get a FreeBSD dom0 in PVH mode, and FreeBSD domU in HVM mode running, >> including installation to disk and networking. >> >> It seemed to me as if the switch 'xen_platform_pci' doesn't have an >> effect on FreeBSD domU's, as I see e.g. a xenpci0 and xbd0 in dmesg no >> matter if I set it to 1 or 0. >> >> Do I understand it correctly, that this switch makes the difference >> between HVM and PVHVM mode? >> According to xl.cfg(5), it 'enables a guest Operating System [...] to >> make use of paravirtualization features such as disk and network devices'. >> >> >> Afterwards, I tried to create a Linux domU. Both Centos 7 and Alpine >> Linux only detected the harddisk with xen_platform_pci=0. >> >> For Alpine Linux, with xen_platform_pci=1, I get the following messages >> on the console: >> >> vbd vbd-5632: 19 xenbus_dev_probe on device/vbd/5632 > That's ENODEV IIRC, I think there's something wrong with FreeBSD disk > backend. > >> vbd vbd-5632: failed to write error node for device/vbd/5632 (19 >> xenbus_dev_probe on device/vbd/5632) >> >> After waiting for a couple minutes it boots, but doesn't detect the disk. >> >> Looking in /var/log/xen/qemu-dm-alpine-hvm.log, I see the following >> messages: >> >> xen be core: can't open gnttab device >> xen be core: can't open gnttab device >> xen be: vkbd-0: initalize() failed >> xen be: vkbd-0: initalize() failed >> xen be: vkbd-0: initalize() failed >> >> >> >> Googling around yielded [3], where someone apparently ran into the same >> problem, and used xen_platform_pci=0 as workaround. >> >> >> >> So my question is: >> Is xen_platform_pci=1 required for PVHVM mode? > No, it shouldn't be. > >> If yes, is PVHVM mode only available for FreeBSD domU's? >> If no, how can I enable it for Linux guests? > If you boot FreeBSD Dom0 kernel with boot_verbose=YES (in > /boot/loader.conf), can you paste the messages you get when trying to > boot the PVHVM guest with xen_platform_pci=1? > > Also, can you paste the output of `xenstore-ls -fp` executed on Dom0 > after the PVHVM guest has failed to boot but is still running? > Hello again, thanks for your response Roger! I attached both. Because I don't know how the mailinglist handles attachments, here is a pastebin of xenstore-ls: https://pastebin.com/s7wa1ee7 And a direct paste of dmesg messages: random: harvesting attach, 8 bytes (4 bits) from xbbd0 tap0: bpf attached tap0: Ethernet address: 00:bd:ee:99:ff:00 tap0: link state changed to UP tap0: changing name to 'xnb2.0-emu' xnb(xnb_probe:1127): Claiming device 0, xnb xnb2.0: bpf attached xnb(xnb_attach:1271): Attaching to backend/vif/2/0 random: harvesting attach, 8 bytes (4 bits) from xnb0 xnb(xnb_frontend_changed:1395): frontend_state=Initialising, xnb_state=InitWait xnb2.0: link state changed to DOWN xnb2.0: link state changed to UP xnb2.0: link state changed to DOWN xnb2.0: promiscuous mode enabled xnb2.0: link state changed to UP xnb2.0-emu: promiscuous mode enabled nd6_dad_timer: cancel DAD on xnb2.0 because of ND6_IFF_IFDISABLED. xnb(xnb_frontend_changed:1395): frontend_state=Connected, xnb_state=InitWait xnb(xnb_connect_comms:788): rings connected! - Kai --------------D8AD9E49249F0A938B795047 Content-Type: text/plain; charset=UTF-8; name="dmesg" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="dmesg" cmFuZG9tOiBoYXJ2ZXN0aW5nIGF0dGFjaCwgOCBieXRlcyAoNCBiaXRzKSBmcm9tIHhiYmQw CnRhcDA6IGJwZiBhdHRhY2hlZAp0YXAwOiBFdGhlcm5ldCBhZGRyZXNzOiAwMDpiZDplZTo5 OTpmZjowMAp0YXAwOiBsaW5rIHN0YXRlIGNoYW5nZWQgdG8gVVAKdGFwMDogY2hhbmdpbmcg bmFtZSB0byAneG5iMi4wLWVtdScKeG5iKHhuYl9wcm9iZToxMTI3KTogQ2xhaW1pbmcgZGV2 aWNlIDAsIHhuYgp4bmIyLjA6IGJwZiBhdHRhY2hlZAp4bmIoeG5iX2F0dGFjaDoxMjcxKTog QXR0YWNoaW5nIHRvIGJhY2tlbmQvdmlmLzIvMApyYW5kb206IGhhcnZlc3RpbmcgYXR0YWNo LCA4IGJ5dGVzICg0IGJpdHMpIGZyb20geG5iMAp4bmIoeG5iX2Zyb250ZW5kX2NoYW5nZWQ6 MTM5NSk6IGZyb250ZW5kX3N0YXRlPUluaXRpYWxpc2luZywgeG5iX3N0YXRlPUluaXRXYWl0 CnhuYjIuMDogbGluayBzdGF0ZSBjaGFuZ2VkIHRvIERPV04KeG5iMi4wOiBsaW5rIHN0YXRl IGNoYW5nZWQgdG8gVVAKeG5iMi4wOiBsaW5rIHN0YXRlIGNoYW5nZWQgdG8gRE9XTgp4bmIy LjA6IHByb21pc2N1b3VzIG1vZGUgZW5hYmxlZAp4bmIyLjA6IGxpbmsgc3RhdGUgY2hhbmdl ZCB0byBVUAp4bmIyLjAtZW11OiBwcm9taXNjdW91cyBtb2RlIGVuYWJsZWQKbmQ2X2RhZF90 aW1lcjogY2FuY2VsIERBRCBvbiB4bmIyLjAgYmVjYXVzZSBvZiBORDZfSUZGX0lGRElTQUJM RUQuCnhuYih4bmJfZnJvbnRlbmRfY2hhbmdlZDoxMzk1KTogZnJvbnRlbmRfc3RhdGU9Q29u bmVjdGVkLCB4bmJfc3RhdGU9SW5pdFdhaXQKeG5iKHhuYl9jb25uZWN0X2NvbW1zOjc4OCk6 IHJpbmdzIGNvbm5lY3RlZCEK --------------D8AD9E49249F0A938B795047 Content-Type: text/plain; charset=UTF-8; name="xenstore-ls" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="xenstore-ls" L3Rvb2wgPSAiIiAgIChuMCkKL3Rvb2wveGVuc3RvcmVkID0gIiIgICAobjApCi92bSA9ICIi ICAgKG4wKQovdm0vMTNmNGQ4ZTgtNTZkMS0xMWU4LTg2ZjctZDA2N2U1ZjA3YTJiID0gIiIg ICAobjAscjIpCi92bS8xM2Y0ZDhlOC01NmQxLTExZTgtODZmNy1kMDY3ZTVmMDdhMmIvbmFt ZSA9ICJhbHBpbmUtaHZtIiAgIChuMCxyMikKL3ZtLzEzZjRkOGU4LTU2ZDEtMTFlOC04NmY3 LWQwNjdlNWYwN2EyYi91dWlkID0gIjEzZjRkOGU4LTU2ZDEtMTFlOC04NmY3LWQwNjdlNWYw N2EyYiIgICAobjAscjIpCi92bS8xM2Y0ZDhlOC01NmQxLTExZTgtODZmNy1kMDY3ZTVmMDdh MmIvcnRjID0gIiIgICAobjAscjIpCi92bS8xM2Y0ZDhlOC01NmQxLTExZTgtODZmNy1kMDY3 ZTVmMDdhMmIvcnRjL3RpbWVvZmZzZXQgPSAiIiAgIChuMCxyMikKL3ZtLzEzZjRkOGU4LTU2 ZDEtMTFlOC04NmY3LWQwNjdlNWYwN2EyYi9pbWFnZSA9ICIiICAgKG4wLHIyKQovdm0vMTNm NGQ4ZTgtNTZkMS0xMWU4LTg2ZjctZDA2N2U1ZjA3YTJiL2ltYWdlL29zdHlwZSA9ICJodm0i ICAgKG4wLHIyKQovdm0vMTNmNGQ4ZTgtNTZkMS0xMWU4LTg2ZjctZDA2N2U1ZjA3YTJiL3N0 YXJ0X3RpbWUgPSAiMTUyNjIzMTY2MS43OCIgICAobjAscjIpCi9saWJ4bCA9ICIiICAgKG4w KQovbGlieGwvMiA9ICIiICAgKG4wKQovbGlieGwvMi9kZXZpY2UgPSAiIiAgIChuMCkKL2xp YnhsLzIvZGV2aWNlL3ZiZCA9ICIiICAgKG4wKQovbGlieGwvMi9kZXZpY2UvdmJkLzUxNzEy ID0gIiIgICAobjApCi9saWJ4bC8yL2RldmljZS92YmQvNTE3MTIvZnJvbnRlbmQgPSAiL2xv Y2FsL2RvbWFpbi8yL2RldmljZS92YmQvNTE3MTIiICAgKG4wKQovbGlieGwvMi9kZXZpY2Uv dmJkLzUxNzEyL2JhY2tlbmQgPSAiL2xvY2FsL2RvbWFpbi8wL2JhY2tlbmQvdmJkLzIvNTE3 MTIiICAgKG4wKQovbGlieGwvMi9kZXZpY2UvdmJkLzUxNzEyL3BhcmFtcyA9ICIvZGV2L3p2 b2wvemJ1bGsvdm0vYWxwaW5lLWh2bV9kaXNrMCIgICAobjApCi9saWJ4bC8yL2RldmljZS92 YmQvNTE3MTIvc2NyaXB0ID0gIi91c3IvbG9jYWwvZXRjL3hlbi9zY3JpcHRzL2Jsb2NrIiAg IChuMCkKL2xpYnhsLzIvZGV2aWNlL3ZiZC81MTcxMi9mcm9udGVuZC1pZCA9ICIyIiAgIChu MCkKL2xpYnhsLzIvZGV2aWNlL3ZiZC81MTcxMi9vbmxpbmUgPSAiMSIgICAobjApCi9saWJ4 bC8yL2RldmljZS92YmQvNTE3MTIvcmVtb3ZhYmxlID0gIjAiICAgKG4wKQovbGlieGwvMi9k ZXZpY2UvdmJkLzUxNzEyL2Jvb3RhYmxlID0gIjEiICAgKG4wKQovbGlieGwvMi9kZXZpY2Uv dmJkLzUxNzEyL3N0YXRlID0gIjEiICAgKG4wKQovbGlieGwvMi9kZXZpY2UvdmJkLzUxNzEy L2RldiA9ICJ4dmRhIiAgIChuMCkKL2xpYnhsLzIvZGV2aWNlL3ZiZC81MTcxMi90eXBlID0g InBoeSIgICAobjApCi9saWJ4bC8yL2RldmljZS92YmQvNTE3MTIvbW9kZSA9ICJ3IiAgIChu MCkKL2xpYnhsLzIvZGV2aWNlL3ZiZC81MTcxMi9kZXZpY2UtdHlwZSA9ICJkaXNrIiAgIChu MCkKL2xpYnhsLzIvZGV2aWNlL3ZiZC81MTcxMi9kaXNjYXJkLWVuYWJsZSA9ICIxIiAgIChu MCkKL2xpYnhsLzIvZGV2aWNlL3ZiZC81MTcyOCA9ICIiICAgKG4wKQovbGlieGwvMi9kZXZp Y2UvdmJkLzUxNzI4L2Zyb250ZW5kID0gIi9sb2NhbC9kb21haW4vMi9kZXZpY2UvdmJkLzUx NzI4IiAgIChuMCkKL2xpYnhsLzIvZGV2aWNlL3ZiZC81MTcyOC9iYWNrZW5kID0gIi9sb2Nh bC9kb21haW4vMC9iYWNrZW5kL3FkaXNrLzIvNTE3MjgiICAgKG4wKQovbGlieGwvMi9kZXZp Y2UvdmJkLzUxNzI4L3BhcmFtcyA9ICJhaW86L3pidWxrL21lZGlhc2hhcmUvaXNvcy9saW51 eC9hbHBpbmUtdmlydC0zLjcuMC14ODZfNjQuaXNvIiAgIChuMCkKL2xpYnhsLzIvZGV2aWNl L3ZiZC81MTcyOC9mcm9udGVuZC1pZCA9ICIyIiAgIChuMCkKL2xpYnhsLzIvZGV2aWNlL3Zi ZC81MTcyOC9vbmxpbmUgPSAiMSIgICAobjApCi9saWJ4bC8yL2RldmljZS92YmQvNTE3Mjgv cmVtb3ZhYmxlID0gIjEiICAgKG4wKQovbGlieGwvMi9kZXZpY2UvdmJkLzUxNzI4L2Jvb3Rh YmxlID0gIjEiICAgKG4wKQovbGlieGwvMi9kZXZpY2UvdmJkLzUxNzI4L3N0YXRlID0gIjEi ICAgKG4wKQovbGlieGwvMi9kZXZpY2UvdmJkLzUxNzI4L2RldiA9ICJ4dmRiIiAgIChuMCkK L2xpYnhsLzIvZGV2aWNlL3ZiZC81MTcyOC90eXBlID0gInFkaXNrIiAgIChuMCkKL2xpYnhs LzIvZGV2aWNlL3ZiZC81MTcyOC9tb2RlID0gInIiICAgKG4wKQovbGlieGwvMi9kZXZpY2Uv dmJkLzUxNzI4L2RldmljZS10eXBlID0gImNkcm9tIiAgIChuMCkKL2xpYnhsLzIvZGV2aWNl L3ZiZC81MTcyOC9kaXNjYXJkLWVuYWJsZSA9ICIwIiAgIChuMCkKL2xpYnhsLzIvZGV2aWNl L2NvbnNvbGUgPSAiIiAgIChuMCkKL2xpYnhsLzIvZGV2aWNlL2NvbnNvbGUvMCA9ICIiICAg KG4wKQovbGlieGwvMi9kZXZpY2UvY29uc29sZS8wL2Zyb250ZW5kID0gIi9sb2NhbC9kb21h aW4vMi9jb25zb2xlIiAgIChuMCkKL2xpYnhsLzIvZGV2aWNlL2NvbnNvbGUvMC9iYWNrZW5k ID0gIi9sb2NhbC9kb21haW4vMC9iYWNrZW5kL2NvbnNvbGUvMi8wIiAgIChuMCkKL2xpYnhs LzIvZGV2aWNlL2NvbnNvbGUvMC9mcm9udGVuZC1pZCA9ICIyIiAgIChuMCkKL2xpYnhsLzIv ZGV2aWNlL2NvbnNvbGUvMC9vbmxpbmUgPSAiMSIgICAobjApCi9saWJ4bC8yL2RldmljZS9j b25zb2xlLzAvc3RhdGUgPSAiMSIgICAobjApCi9saWJ4bC8yL2RldmljZS9jb25zb2xlLzAv cHJvdG9jb2wgPSAidnQxMDAiICAgKG4wKQovbGlieGwvMi9kZXZpY2UvdmtiZCA9ICIiICAg KG4wKQovbGlieGwvMi9kZXZpY2UvdmtiZC8wID0gIiIgICAobjApCi9saWJ4bC8yL2Rldmlj ZS92a2JkLzAvZnJvbnRlbmQgPSAiL2xvY2FsL2RvbWFpbi8yL2RldmljZS92a2JkLzAiICAg KG4wKQovbGlieGwvMi9kZXZpY2UvdmtiZC8wL2JhY2tlbmQgPSAiL2xvY2FsL2RvbWFpbi8w L2JhY2tlbmQvdmtiZC8yLzAiICAgKG4wKQovbGlieGwvMi9kZXZpY2UvdmtiZC8wL2Zyb250 ZW5kLWlkID0gIjIiICAgKG4wKQovbGlieGwvMi9kZXZpY2UvdmtiZC8wL29ubGluZSA9ICIx IiAgIChuMCkKL2xpYnhsLzIvZGV2aWNlL3ZrYmQvMC9zdGF0ZSA9ICIxIiAgIChuMCkKL2xp YnhsLzIvZGV2aWNlL3ZpZiA9ICIiICAgKG4wKQovbGlieGwvMi9kZXZpY2UvdmlmLzAgPSAi IiAgIChuMCkKL2xpYnhsLzIvZGV2aWNlL3ZpZi8wL2Zyb250ZW5kID0gIi9sb2NhbC9kb21h aW4vMi9kZXZpY2UvdmlmLzAiICAgKG4wKQovbGlieGwvMi9kZXZpY2UvdmlmLzAvYmFja2Vu ZCA9ICIvbG9jYWwvZG9tYWluLzAvYmFja2VuZC92aWYvMi8wIiAgIChuMCkKL2xpYnhsLzIv ZGV2aWNlL3ZpZi8wL2Zyb250ZW5kLWlkID0gIjIiICAgKG4wKQovbGlieGwvMi9kZXZpY2Uv dmlmLzAvb25saW5lID0gIjEiICAgKG4wKQovbGlieGwvMi9kZXZpY2UvdmlmLzAvc3RhdGUg PSAiMSIgICAobjApCi9saWJ4bC8yL2RldmljZS92aWYvMC9zY3JpcHQgPSAiL3Vzci9sb2Nh bC9ldGMveGVuL3NjcmlwdHMvdmlmLWJyaWRnZSIgICAobjApCi9saWJ4bC8yL2RldmljZS92 aWYvMC9tYWMgPSAiMDA6MTY6M2U6MTM6ZjU6ZTAiICAgKG4wKQovbGlieGwvMi9kZXZpY2Uv dmlmLzAvYnJpZGdlID0gImJyaWRnZTAiICAgKG4wKQovbGlieGwvMi9kZXZpY2UvdmlmLzAv aGFuZGxlID0gIjAiICAgKG4wKQovbGlieGwvMi9kZXZpY2UvdmlmLzAvdHlwZSA9ICJ2aWZf aW9lbXUiICAgKG4wKQovbGlieGwvMi9kbS12ZXJzaW9uID0gInFlbXVfeGVuIiAgIChuMCkK L2xvY2FsID0gIiIgICAobjApCi9sb2NhbC9kb21haW4gPSAiIiAgIChuMCkKL2xvY2FsL2Rv bWFpbi8wID0gIiIgICAobjApCi9sb2NhbC9kb21haW4vMC9kb21pZCA9ICIwIiAgIChuMCkK L2xvY2FsL2RvbWFpbi8wL25hbWUgPSAiRG9tYWluLTAiICAgKG4wKQovbG9jYWwvZG9tYWlu LzAvZGV2aWNlLW1vZGVsID0gIiIgICAobjApCi9sb2NhbC9kb21haW4vMC9kZXZpY2UtbW9k ZWwvMiA9ICIiICAgKG4wKQovbG9jYWwvZG9tYWluLzAvZGV2aWNlLW1vZGVsLzIvc3RhdGUg PSAicnVubmluZyIgICAobjApCi9sb2NhbC9kb21haW4vMC9kZXZpY2UtbW9kZWwvMi9waHlz bWFwID0gIiIgICAobjApCi9sb2NhbC9kb21haW4vMC9kZXZpY2UtbW9kZWwvMi9waHlzbWFw LzNmODAwMDAwID0gIiIgICAobjApCi9sb2NhbC9kb21haW4vMC9kZXZpY2UtbW9kZWwvMi9w aHlzbWFwLzNmODAwMDAwL3N0YXJ0X2FkZHIgPSAiZjAwMDAwMDAiICAgKG4wKQovbG9jYWwv ZG9tYWluLzAvZGV2aWNlLW1vZGVsLzIvcGh5c21hcC8zZjgwMDAwMC9zaXplID0gIjgwMDAw MCIgICAobjApCi9sb2NhbC9kb21haW4vMC9kZXZpY2UtbW9kZWwvMi9waHlzbWFwLzNmODAw MDAwL25hbWUgPSAidmdhLnZyYW0iICAgKG4wKQovbG9jYWwvZG9tYWluLzAvYmFja2VuZCA9 ICIiICAgKG4wKQovbG9jYWwvZG9tYWluLzAvYmFja2VuZC92YmQgPSAiIiAgIChuMCkKL2xv Y2FsL2RvbWFpbi8wL2JhY2tlbmQvdmJkLzIgPSAiIiAgIChuMCkKL2xvY2FsL2RvbWFpbi8w L2JhY2tlbmQvdmJkLzIvNTE3MTIgPSAiIiAgIChuMCxyMikKL2xvY2FsL2RvbWFpbi8wL2Jh Y2tlbmQvdmJkLzIvNTE3MTIvZnJvbnRlbmQgPSAiL2xvY2FsL2RvbWFpbi8yL2RldmljZS92 YmQvNTE3MTIiICAgKG4wLHIyKQovbG9jYWwvZG9tYWluLzAvYmFja2VuZC92YmQvMi81MTcx Mi9wYXJhbXMgPSAiL2Rldi96dm9sL3pidWxrL3ZtL2FscGluZS1odm1fZGlzazAiICAgKG4w LHIyKQovbG9jYWwvZG9tYWluLzAvYmFja2VuZC92YmQvMi81MTcxMi9zY3JpcHQgPSAiL3Vz ci9sb2NhbC9ldGMveGVuL3NjcmlwdHMvYmxvY2siICAgKG4wLHIyKQovbG9jYWwvZG9tYWlu LzAvYmFja2VuZC92YmQvMi81MTcxMi9mcm9udGVuZC1pZCA9ICIyIiAgIChuMCxyMikKL2xv Y2FsL2RvbWFpbi8wL2JhY2tlbmQvdmJkLzIvNTE3MTIvb25saW5lID0gIjEiICAgKG4wLHIy KQovbG9jYWwvZG9tYWluLzAvYmFja2VuZC92YmQvMi81MTcxMi9yZW1vdmFibGUgPSAiMCIg ICAobjAscjIpCi9sb2NhbC9kb21haW4vMC9iYWNrZW5kL3ZiZC8yLzUxNzEyL2Jvb3RhYmxl ID0gIjEiICAgKG4wLHIyKQovbG9jYWwvZG9tYWluLzAvYmFja2VuZC92YmQvMi81MTcxMi9z dGF0ZSA9ICIzIiAgIChuMCxyMikKL2xvY2FsL2RvbWFpbi8wL2JhY2tlbmQvdmJkLzIvNTE3 MTIvZGV2ID0gInh2ZGEiICAgKG4wLHIyKQovbG9jYWwvZG9tYWluLzAvYmFja2VuZC92YmQv Mi81MTcxMi90eXBlID0gInBoeSIgICAobjAscjIpCi9sb2NhbC9kb21haW4vMC9iYWNrZW5k L3ZiZC8yLzUxNzEyL21vZGUgPSAidyIgICAobjAscjIpCi9sb2NhbC9kb21haW4vMC9iYWNr ZW5kL3ZiZC8yLzUxNzEyL2RldmljZS10eXBlID0gImRpc2siICAgKG4wLHIyKQovbG9jYWwv ZG9tYWluLzAvYmFja2VuZC92YmQvMi81MTcxMi9kaXNjYXJkLWVuYWJsZSA9ICIxIiAgIChu MCxyMikKL2xvY2FsL2RvbWFpbi8wL2JhY2tlbmQvdmJkLzIvNTE3MTIvZmVhdHVyZS1iYXJy aWVyID0gIjEiICAgKG4wLHIyKQovbG9jYWwvZG9tYWluLzAvYmFja2VuZC92YmQvMi81MTcx Mi9mZWF0dXJlLWZsdXNoLWNhY2hlID0gIjEiICAgKG4wLHIyKQovbG9jYWwvZG9tYWluLzAv YmFja2VuZC92YmQvMi81MTcxMi9tYXgtcmluZy1wYWdlLW9yZGVyID0gIjUiICAgKG4wLHIy KQovbG9jYWwvZG9tYWluLzAvYmFja2VuZC92YmQvMi81MTcxMi9waHlzaWNhbC1kZXZpY2Ut cGF0aCA9ICIvZGV2L3p2b2wvemJ1bGsvdm0vYWxwaW5lLWh2bV9kaXNrMCIgICAobjAscjIp Ci9sb2NhbC9kb21haW4vMC9iYWNrZW5kL3ZiZC8yLzUxNzEyL2hvdHBsdWctc3RhdHVzID0g ImNvbm5lY3RlZCIgICAobjAscjIpCi9sb2NhbC9kb21haW4vMC9iYWNrZW5kL3FkaXNrID0g IiIgICAobjApCi9sb2NhbC9kb21haW4vMC9iYWNrZW5kL3FkaXNrLzIgPSAiIiAgIChuMCkK L2xvY2FsL2RvbWFpbi8wL2JhY2tlbmQvcWRpc2svMi81MTcyOCA9ICIiICAgKG4wLHIyKQov bG9jYWwvZG9tYWluLzAvYmFja2VuZC9xZGlzay8yLzUxNzI4L2Zyb250ZW5kID0gIi9sb2Nh bC9kb21haW4vMi9kZXZpY2UvdmJkLzUxNzI4IiAgIChuMCxyMikKL2xvY2FsL2RvbWFpbi8w L2JhY2tlbmQvcWRpc2svMi81MTcyOC9wYXJhbXMgPSAiYWlvOi96YnVsay9tZWRpYXNoYXJl L2lzb3MvbGludXgvYWxwaW5lLXZpcnQtMy43LjAteDg2XzY0LmlzbyIgICAobjAscjIpCi9s b2NhbC9kb21haW4vMC9iYWNrZW5kL3FkaXNrLzIvNTE3MjgvZnJvbnRlbmQtaWQgPSAiMiIg ICAobjAscjIpCi9sb2NhbC9kb21haW4vMC9iYWNrZW5kL3FkaXNrLzIvNTE3Mjgvb25saW5l ID0gIjEiICAgKG4wLHIyKQovbG9jYWwvZG9tYWluLzAvYmFja2VuZC9xZGlzay8yLzUxNzI4 L3JlbW92YWJsZSA9ICIxIiAgIChuMCxyMikKL2xvY2FsL2RvbWFpbi8wL2JhY2tlbmQvcWRp c2svMi81MTcyOC9ib290YWJsZSA9ICIxIiAgIChuMCxyMikKL2xvY2FsL2RvbWFpbi8wL2Jh Y2tlbmQvcWRpc2svMi81MTcyOC9zdGF0ZSA9ICIxIiAgIChuMCxyMikKL2xvY2FsL2RvbWFp bi8wL2JhY2tlbmQvcWRpc2svMi81MTcyOC9kZXYgPSAieHZkYiIgICAobjAscjIpCi9sb2Nh bC9kb21haW4vMC9iYWNrZW5kL3FkaXNrLzIvNTE3MjgvdHlwZSA9ICJxZGlzayIgICAobjAs cjIpCi9sb2NhbC9kb21haW4vMC9iYWNrZW5kL3FkaXNrLzIvNTE3MjgvbW9kZSA9ICJyIiAg IChuMCxyMikKL2xvY2FsL2RvbWFpbi8wL2JhY2tlbmQvcWRpc2svMi81MTcyOC9kZXZpY2Ut dHlwZSA9ICJjZHJvbSIgICAobjAscjIpCi9sb2NhbC9kb21haW4vMC9iYWNrZW5kL3FkaXNr LzIvNTE3MjgvZGlzY2FyZC1lbmFibGUgPSAiMCIgICAobjAscjIpCi9sb2NhbC9kb21haW4v MC9iYWNrZW5kL2NvbnNvbGUgPSAiIiAgIChuMCkKL2xvY2FsL2RvbWFpbi8wL2JhY2tlbmQv Y29uc29sZS8yID0gIiIgICAobjApCi9sb2NhbC9kb21haW4vMC9iYWNrZW5kL2NvbnNvbGUv Mi8wID0gIiIgICAobjAscjIpCi9sb2NhbC9kb21haW4vMC9iYWNrZW5kL2NvbnNvbGUvMi8w L2Zyb250ZW5kID0gIi9sb2NhbC9kb21haW4vMi9jb25zb2xlIiAgIChuMCxyMikKL2xvY2Fs L2RvbWFpbi8wL2JhY2tlbmQvY29uc29sZS8yLzAvZnJvbnRlbmQtaWQgPSAiMiIgICAobjAs cjIpCi9sb2NhbC9kb21haW4vMC9iYWNrZW5kL2NvbnNvbGUvMi8wL29ubGluZSA9ICIxIiAg IChuMCxyMikKL2xvY2FsL2RvbWFpbi8wL2JhY2tlbmQvY29uc29sZS8yLzAvc3RhdGUgPSAi MSIgICAobjAscjIpCi9sb2NhbC9kb21haW4vMC9iYWNrZW5kL2NvbnNvbGUvMi8wL3Byb3Rv Y29sID0gInZ0MTAwIiAgIChuMCxyMikKL2xvY2FsL2RvbWFpbi8wL2JhY2tlbmQvdmtiZCA9 ICIiICAgKG4wKQovbG9jYWwvZG9tYWluLzAvYmFja2VuZC92a2JkLzIgPSAiIiAgIChuMCkK L2xvY2FsL2RvbWFpbi8wL2JhY2tlbmQvdmtiZC8yLzAgPSAiIiAgIChuMCxyMikKL2xvY2Fs L2RvbWFpbi8wL2JhY2tlbmQvdmtiZC8yLzAvZnJvbnRlbmQgPSAiL2xvY2FsL2RvbWFpbi8y L2RldmljZS92a2JkLzAiICAgKG4wLHIyKQovbG9jYWwvZG9tYWluLzAvYmFja2VuZC92a2Jk LzIvMC9mcm9udGVuZC1pZCA9ICIyIiAgIChuMCxyMikKL2xvY2FsL2RvbWFpbi8wL2JhY2tl bmQvdmtiZC8yLzAvb25saW5lID0gIjEiICAgKG4wLHIyKQovbG9jYWwvZG9tYWluLzAvYmFj a2VuZC92a2JkLzIvMC9zdGF0ZSA9ICIyIiAgIChuMCxyMikKL2xvY2FsL2RvbWFpbi8wL2Jh Y2tlbmQvdmtiZC8yLzAvZmVhdHVyZS1hYnMtcG9pbnRlciA9ICIxIiAgIChuMCxyMikKL2xv Y2FsL2RvbWFpbi8wL2JhY2tlbmQvdmtiZC8yLzAvaG90cGx1Zy1zdGF0dXMgPSAiY29ubmVj dGVkIiAgIChuMCxyMikKL2xvY2FsL2RvbWFpbi8wL2JhY2tlbmQvdmlmID0gIiIgICAobjAp Ci9sb2NhbC9kb21haW4vMC9iYWNrZW5kL3ZpZi8yID0gIiIgICAobjApCi9sb2NhbC9kb21h aW4vMC9iYWNrZW5kL3ZpZi8yLzAgPSAiIiAgIChuMCxyMikKL2xvY2FsL2RvbWFpbi8wL2Jh Y2tlbmQvdmlmLzIvMC9mcm9udGVuZCA9ICIvbG9jYWwvZG9tYWluLzIvZGV2aWNlL3ZpZi8w IiAgIChuMCxyMikKL2xvY2FsL2RvbWFpbi8wL2JhY2tlbmQvdmlmLzIvMC9mcm9udGVuZC1p ZCA9ICIyIiAgIChuMCxyMikKL2xvY2FsL2RvbWFpbi8wL2JhY2tlbmQvdmlmLzIvMC9vbmxp bmUgPSAiMSIgICAobjAscjIpCi9sb2NhbC9kb21haW4vMC9iYWNrZW5kL3ZpZi8yLzAvc3Rh dGUgPSAiNCIgICAobjAscjIpCi9sb2NhbC9kb21haW4vMC9iYWNrZW5kL3ZpZi8yLzAvc2Ny aXB0ID0gIi91c3IvbG9jYWwvZXRjL3hlbi9zY3JpcHRzL3ZpZi1icmlkZ2UiICAgKG4wLHIy KQovbG9jYWwvZG9tYWluLzAvYmFja2VuZC92aWYvMi8wL21hYyA9ICIwMDoxNjozZToxMzpm NTplMCIgICAobjAscjIpCi9sb2NhbC9kb21haW4vMC9iYWNrZW5kL3ZpZi8yLzAvYnJpZGdl ID0gImJyaWRnZTAiICAgKG4wLHIyKQovbG9jYWwvZG9tYWluLzAvYmFja2VuZC92aWYvMi8w L2hhbmRsZSA9ICIwIiAgIChuMCxyMikKL2xvY2FsL2RvbWFpbi8wL2JhY2tlbmQvdmlmLzIv MC90eXBlID0gInZpZl9pb2VtdSIgICAobjAscjIpCi9sb2NhbC9kb21haW4vMC9iYWNrZW5k L3ZpZi8yLzAvaG90cGx1Zy1zdGF0dXMgPSAiY29ubmVjdGVkIiAgIChuMCxyMikKL2xvY2Fs L2RvbWFpbi8wL2JhY2tlbmQvdmlmLzIvMC9mZWF0dXJlLXNnID0gIjEiICAgKG4wLHIyKQov bG9jYWwvZG9tYWluLzAvYmFja2VuZC92aWYvMi8wL2ZlYXR1cmUtZ3NvLXRjcHY0ID0gIjAi ICAgKG4wLHIyKQovbG9jYWwvZG9tYWluLzAvYmFja2VuZC92aWYvMi8wL2ZlYXR1cmUtcngt Y29weSA9ICIxIiAgIChuMCxyMikKL2xvY2FsL2RvbWFpbi8wL2JhY2tlbmQvdmlmLzIvMC9m ZWF0dXJlLXJ4LWZsaXAgPSAiMCIgICAobjAscjIpCi9sb2NhbC9kb21haW4vMiA9ICIiICAg KG4wLHIyKQovbG9jYWwvZG9tYWluLzIvdm0gPSAiL3ZtLzEzZjRkOGU4LTU2ZDEtMTFlOC04 NmY3LWQwNjdlNWYwN2EyYiIgICAobjAscjIpCi9sb2NhbC9kb21haW4vMi9uYW1lID0gImFs cGluZS1odm0iICAgKG4wLHIyKQovbG9jYWwvZG9tYWluLzIvY3B1ID0gIiIgICAobjAscjIp Ci9sb2NhbC9kb21haW4vMi9jcHUvMCA9ICIiICAgKG4wLHIyKQovbG9jYWwvZG9tYWluLzIv Y3B1LzAvYXZhaWxhYmlsaXR5ID0gIm9ubGluZSIgICAobjAscjIpCi9sb2NhbC9kb21haW4v Mi9tZW1vcnkgPSAiIiAgIChuMCxyMikKL2xvY2FsL2RvbWFpbi8yL21lbW9yeS9zdGF0aWMt bWF4ID0gIjEwNDg1NzYiICAgKG4wLHIyKQovbG9jYWwvZG9tYWluLzIvbWVtb3J5L3Rhcmdl dCA9ICIxMDQwMzg0IiAgIChuMCxyMikKL2xvY2FsL2RvbWFpbi8yL21lbW9yeS92aWRlb3Jh bSA9ICI4MTkyIiAgIChuMCxyMikKL2xvY2FsL2RvbWFpbi8yL2RldmljZSA9ICIiICAgKG4w LHIyKQovbG9jYWwvZG9tYWluLzIvZGV2aWNlL3N1c3BlbmQgPSAiIiAgIChuMCxyMikKL2xv Y2FsL2RvbWFpbi8yL2RldmljZS9zdXNwZW5kL2V2ZW50LWNoYW5uZWwgPSAiIiAgIChuMikK L2xvY2FsL2RvbWFpbi8yL2RldmljZS92YmQgPSAiIiAgIChuMCxyMikKL2xvY2FsL2RvbWFp bi8yL2RldmljZS92YmQvNTE3MTIgPSAiIiAgIChuMixyMCkKL2xvY2FsL2RvbWFpbi8yL2Rl dmljZS92YmQvNTE3MTIvYmFja2VuZCA9ICIvbG9jYWwvZG9tYWluLzAvYmFja2VuZC92YmQv Mi81MTcxMiIgICAobjIscjApCi9sb2NhbC9kb21haW4vMi9kZXZpY2UvdmJkLzUxNzEyL2Jh Y2tlbmQtaWQgPSAiMCIgICAobjIscjApCi9sb2NhbC9kb21haW4vMi9kZXZpY2UvdmJkLzUx NzEyL3N0YXRlID0gIjEiICAgKG4yLHIwKQovbG9jYWwvZG9tYWluLzIvZGV2aWNlL3ZiZC81 MTcxMi92aXJ0dWFsLWRldmljZSA9ICI1MTcxMiIgICAobjIscjApCi9sb2NhbC9kb21haW4v Mi9kZXZpY2UvdmJkLzUxNzEyL2RldmljZS10eXBlID0gImRpc2siICAgKG4yLHIwKQovbG9j YWwvZG9tYWluLzIvZGV2aWNlL3ZiZC81MTcyOCA9ICIiICAgKG4yLHIwKQovbG9jYWwvZG9t YWluLzIvZGV2aWNlL3ZiZC81MTcyOC9iYWNrZW5kID0gIi9sb2NhbC9kb21haW4vMC9iYWNr ZW5kL3FkaXNrLzIvNTE3MjgiICAgKG4yLHIwKQovbG9jYWwvZG9tYWluLzIvZGV2aWNlL3Zi ZC81MTcyOC9iYWNrZW5kLWlkID0gIjAiICAgKG4yLHIwKQovbG9jYWwvZG9tYWluLzIvZGV2 aWNlL3ZiZC81MTcyOC9zdGF0ZSA9ICI2IiAgIChuMixyMCkKL2xvY2FsL2RvbWFpbi8yL2Rl dmljZS92YmQvNTE3MjgvdmlydHVhbC1kZXZpY2UgPSAiNTE3MjgiICAgKG4yLHIwKQovbG9j YWwvZG9tYWluLzIvZGV2aWNlL3ZiZC81MTcyOC9kZXZpY2UtdHlwZSA9ICJjZHJvbSIgICAo bjIscjApCi9sb2NhbC9kb21haW4vMi9kZXZpY2UvdmtiZCA9ICIiICAgKG4wLHIyKQovbG9j YWwvZG9tYWluLzIvZGV2aWNlL3ZrYmQvMCA9ICIiICAgKG4yLHIwKQovbG9jYWwvZG9tYWlu LzIvZGV2aWNlL3ZrYmQvMC9iYWNrZW5kID0gIi9sb2NhbC9kb21haW4vMC9iYWNrZW5kL3Zr YmQvMi8wIiAgIChuMixyMCkKL2xvY2FsL2RvbWFpbi8yL2RldmljZS92a2JkLzAvYmFja2Vu ZC1pZCA9ICIwIiAgIChuMixyMCkKL2xvY2FsL2RvbWFpbi8yL2RldmljZS92a2JkLzAvc3Rh dGUgPSAiNCIgICAobjIscjApCi9sb2NhbC9kb21haW4vMi9kZXZpY2UvdmtiZC8wL3JlcXVl c3QtYWJzLXBvaW50ZXIgPSAiMSIgICAobjIscjApCi9sb2NhbC9kb21haW4vMi9kZXZpY2Uv dmtiZC8wL3BhZ2UtcmVmID0gIjI0OTY5MyIgICAobjIscjApCi9sb2NhbC9kb21haW4vMi9k ZXZpY2UvdmtiZC8wL3BhZ2UtZ3JlZiA9ICI4IiAgIChuMixyMCkKL2xvY2FsL2RvbWFpbi8y L2RldmljZS92a2JkLzAvZXZlbnQtY2hhbm5lbCA9ICIxNCIgICAobjIscjApCi9sb2NhbC9k b21haW4vMi9kZXZpY2UvdmlmID0gIiIgICAobjAscjIpCi9sb2NhbC9kb21haW4vMi9kZXZp Y2UvdmlmLzAgPSAiIiAgIChuMixyMCkKL2xvY2FsL2RvbWFpbi8yL2RldmljZS92aWYvMC9i YWNrZW5kID0gIi9sb2NhbC9kb21haW4vMC9iYWNrZW5kL3ZpZi8yLzAiICAgKG4yLHIwKQov bG9jYWwvZG9tYWluLzIvZGV2aWNlL3ZpZi8wL2JhY2tlbmQtaWQgPSAiMCIgICAobjIscjAp Ci9sb2NhbC9kb21haW4vMi9kZXZpY2UvdmlmLzAvc3RhdGUgPSAiNCIgICAobjIscjApCi9s b2NhbC9kb21haW4vMi9kZXZpY2UvdmlmLzAvaGFuZGxlID0gIjAiICAgKG4yLHIwKQovbG9j YWwvZG9tYWluLzIvZGV2aWNlL3ZpZi8wL21hYyA9ICIwMDoxNjozZToxMzpmNTplMCIgICAo bjIscjApCi9sb2NhbC9kb21haW4vMi9kZXZpY2UvdmlmLzAvdHgtcmluZy1yZWYgPSAiNzY4 IiAgIChuMixyMCkKL2xvY2FsL2RvbWFpbi8yL2RldmljZS92aWYvMC9yeC1yaW5nLXJlZiA9 ICI3NjkiICAgKG4yLHIwKQovbG9jYWwvZG9tYWluLzIvZGV2aWNlL3ZpZi8wL2V2ZW50LWNo YW5uZWwgPSAiMTYiICAgKG4yLHIwKQovbG9jYWwvZG9tYWluLzIvZGV2aWNlL3ZpZi8wL3Jl cXVlc3QtcngtY29weSA9ICIxIiAgIChuMixyMCkKL2xvY2FsL2RvbWFpbi8yL2RldmljZS92 aWYvMC9mZWF0dXJlLXJ4LW5vdGlmeSA9ICIxIiAgIChuMixyMCkKL2xvY2FsL2RvbWFpbi8y L2RldmljZS92aWYvMC9mZWF0dXJlLXNnID0gIjEiICAgKG4yLHIwKQovbG9jYWwvZG9tYWlu LzIvZGV2aWNlL3ZpZi8wL2ZlYXR1cmUtZ3NvLXRjcHY0ID0gIjEiICAgKG4yLHIwKQovbG9j YWwvZG9tYWluLzIvZGV2aWNlL3ZpZi8wL2ZlYXR1cmUtZ3NvLXRjcHY2ID0gIjEiICAgKG4y LHIwKQovbG9jYWwvZG9tYWluLzIvZGV2aWNlL3ZpZi8wL2ZlYXR1cmUtaXB2Ni1jc3VtLW9m ZmxvYWQgPSAiMSIgICAobjIscjApCi9sb2NhbC9kb21haW4vMi9jb250cm9sID0gIiIgICAo bjAscjIpCi9sb2NhbC9kb21haW4vMi9jb250cm9sL3NodXRkb3duID0gIiIgICAobjIpCi9s b2NhbC9kb21haW4vMi9jb250cm9sL3BsYXRmb3JtLWZlYXR1cmUtbXVsdGlwcm9jZXNzb3It c3VzcGVuZCA9ICIxIiAgIChuMCxyMikKL2xvY2FsL2RvbWFpbi8yL2NvbnRyb2wvcGxhdGZv cm0tZmVhdHVyZS14c19yZXNldF93YXRjaGVzID0gIjEiICAgKG4wLHIyKQovbG9jYWwvZG9t YWluLzIvaHZtbG9hZGVyID0gIiIgICAobjAscjIpCi9sb2NhbC9kb21haW4vMi9odm1sb2Fk ZXIvYmlvcyA9ICJzZWFiaW9zIiAgIChuMCxyMikKL2xvY2FsL2RvbWFpbi8yL2h2bWxvYWRl ci9hbGxvdy1tZW1vcnktcmVsb2NhdGUgPSAiMCIgICAobjAscjIpCi9sb2NhbC9kb21haW4v Mi9kYXRhID0gIiIgICAobjIpCi9sb2NhbC9kb21haW4vMi9kcml2ZXJzID0gIiIgICAobjIp Ci9sb2NhbC9kb21haW4vMi9mZWF0dXJlID0gIiIgICAobjIpCi9sb2NhbC9kb21haW4vMi9h dHRyID0gIiIgICAobjIpCi9sb2NhbC9kb21haW4vMi9kb21pZCA9ICIyIiAgIChuMCxyMikK L2xvY2FsL2RvbWFpbi8yL3N0b3JlID0gIiIgICAobjAscjIpCi9sb2NhbC9kb21haW4vMi9z dG9yZS9wb3J0ID0gIjEiICAgKG4wLHIyKQovbG9jYWwvZG9tYWluLzIvc3RvcmUvcmluZy1y ZWYgPSAiMTA0NDQ3NiIgICAobjAscjIpCi9sb2NhbC9kb21haW4vMi9wbGF0Zm9ybSA9ICIi ICAgKG4wLHIyKQovbG9jYWwvZG9tYWluLzIvcGxhdGZvcm0vYWNwaSA9ICIxIiAgIChuMCxy MikKL2xvY2FsL2RvbWFpbi8yL3BsYXRmb3JtL2FjcGlfczMgPSAiMSIgICAobjAscjIpCi9s b2NhbC9kb21haW4vMi9wbGF0Zm9ybS9hY3BpX3M0ID0gIjEiICAgKG4wLHIyKQovbG9jYWwv ZG9tYWluLzIvY29uc29sZSA9ICIiICAgKG4wLHIyKQovbG9jYWwvZG9tYWluLzIvY29uc29s ZS9iYWNrZW5kID0gIi9sb2NhbC9kb21haW4vMC9iYWNrZW5kL2NvbnNvbGUvMi8wIiAgIChu MCxyMikKL2xvY2FsL2RvbWFpbi8yL2NvbnNvbGUvYmFja2VuZC1pZCA9ICIwIiAgIChuMixy MCkKL2xvY2FsL2RvbWFpbi8yL2NvbnNvbGUvbGltaXQgPSAiMTA0ODU3NiIgICAobjAscjIp Ci9sb2NhbC9kb21haW4vMi9jb25zb2xlL3R5cGUgPSAieGVuY29uc29sZWQiICAgKG4wLHIy KQovbG9jYWwvZG9tYWluLzIvY29uc29sZS9vdXRwdXQgPSAicHR5IiAgIChuMCxyMikKL2xv Y2FsL2RvbWFpbi8yL2NvbnNvbGUvdHR5ID0gIi9kZXYvcHRzLzIiICAgKG4wLHIyKQovbG9j YWwvZG9tYWluLzIvY29uc29sZS9wb3J0ID0gIjIiICAgKG4wLHIyKQovbG9jYWwvZG9tYWlu LzIvY29uc29sZS9yaW5nLXJlZiA9ICIxMDQ0NDc5IiAgIChuMCxyMikKL2xvY2FsL2RvbWFp bi8yL2NvbnNvbGUvdm5jLWxpc3RlbiA9ICIwLjAuMC4wIiAgIChuMCxyMikKL2xvY2FsL2Rv bWFpbi8yL2NvbnNvbGUvdm5jLXBvcnQgPSAiNTkwMCIgICAobjAscjIpCi9sb2NhbC9kb21h aW4vMi9pbWFnZSA9ICIiICAgKG4wLHIyKQovbG9jYWwvZG9tYWluLzIvaW1hZ2UvZGV2aWNl LW1vZGVsLXBpZCA9ICIxMDg5IiAgIChuMCxyMikKL2xvY2FsL2RvbWFpbi8yL3NlcmlhbCA9 ICIiICAgKG4wLHIyKQovbG9jYWwvZG9tYWluLzIvc2VyaWFsLzAgPSAiIiAgIChuMCxyMikK L2xvY2FsL2RvbWFpbi8yL3NlcmlhbC8wL3R0eSA9ICIvZGV2L3B0cy8zIiAgIChuMCxyMikK --------------D8AD9E49249F0A938B795047-- From owner-freebsd-xen@freebsd.org Mon May 14 13:04:53 2018 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9428ED9289C for ; Mon, 14 May 2018 13:04:53 +0000 (UTC) (envelope-from royger@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "smtp.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4792273E76; Mon, 14 May 2018 13:04:53 +0000 (UTC) (envelope-from royger@FreeBSD.org) Received: from localhost (default-46-102-197-194.interdsl.co.uk [46.102.197.194]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) (Authenticated sender: royger) by smtp.freebsd.org (Postfix) with ESMTPSA id DC45516C81; Mon, 14 May 2018 13:04:52 +0000 (UTC) (envelope-from royger@FreeBSD.org) Date: Mon, 14 May 2018 14:04:45 +0100 From: Roger Pau =?utf-8?B?TW9ubsOp?= To: Kai Otto Cc: freebsd-xen@freebsd.org Subject: Re: Linux domU only works with xen_platform_pci=0 ? Message-ID: <20180514130445.ahqk5ol3kdhriqju@MacBook-Pro-de-Roger.local> References: <20180513151649.4ls73myegkhm3cep@MacBook-Pro-de-Roger.local> <0749df4b-1614-dcdf-1bf2-1bbad1ae5743@duckster.net> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <0749df4b-1614-dcdf-1bf2-1bbad1ae5743@duckster.net> User-Agent: NeoMutt/20180323 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.26 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 May 2018 13:04:53 -0000 On Sun, May 13, 2018 at 07:33:03PM +0200, Kai Otto wrote: > On 13/05/18 17:16, Roger Pau Monné wrote: > > On Sun, May 13, 2018 at 03:51:36PM +0200, Kai Otto wrote: > >> Hello, > >> > >> I'm trying to set up a FreeBSD 11.1 system as Xen virtualization host. > >> Following a combination of handbook [1] and wiki [2], I was able to get > >> get a FreeBSD dom0 in PVH mode, and FreeBSD domU in HVM mode running, > >> including installation to disk and networking. > >> > >> It seemed to me as if the switch 'xen_platform_pci' doesn't have an > >> effect on FreeBSD domU's, as I see e.g. a xenpci0 and xbd0 in dmesg no > >> matter if I set it to 1 or 0. > >> > >> Do I understand it correctly, that this switch makes the difference > >> between HVM and PVHVM mode? > >> According to xl.cfg(5), it 'enables a guest Operating System [...] to > >> make use of paravirtualization features such as disk and network devices'. > >> > >> > >> Afterwards, I tried to create a Linux domU. Both Centos 7 and Alpine > >> Linux only detected the harddisk with xen_platform_pci=0. > >> > >> For Alpine Linux, with xen_platform_pci=1, I get the following messages > >> on the console: > >> > >> vbd vbd-5632: 19 xenbus_dev_probe on device/vbd/5632 > > That's ENODEV IIRC, I think there's something wrong with FreeBSD disk > > backend. > > > >> vbd vbd-5632: failed to write error node for device/vbd/5632 (19 > >> xenbus_dev_probe on device/vbd/5632) > >> > >> After waiting for a couple minutes it boots, but doesn't detect the disk. > >> > >> Looking in /var/log/xen/qemu-dm-alpine-hvm.log, I see the following > >> messages: > >> > >> xen be core: can't open gnttab device > >> xen be core: can't open gnttab device > >> xen be: vkbd-0: initalize() failed > >> xen be: vkbd-0: initalize() failed > >> xen be: vkbd-0: initalize() failed > >> > >> > >> > >> Googling around yielded [3], where someone apparently ran into the same > >> problem, and used xen_platform_pci=0 as workaround. > >> > >> > >> > >> So my question is: > >> Is xen_platform_pci=1 required for PVHVM mode? > > No, it shouldn't be. > > > >> If yes, is PVHVM mode only available for FreeBSD domU's? > >> If no, how can I enable it for Linux guests? > > If you boot FreeBSD Dom0 kernel with boot_verbose=YES (in > > /boot/loader.conf), can you paste the messages you get when trying to > > boot the PVHVM guest with xen_platform_pci=1? > > > > Also, can you paste the output of `xenstore-ls -fp` executed on Dom0 > > after the PVHVM guest has failed to boot but is still running? > > > Hello again, > thanks for your response Roger! > > I attached both. Because I don't know how the mailinglist handles > attachments, here is a pastebin of xenstore-ls: > https://pastebin.com/s7wa1ee7 > And a direct paste of dmesg messages: > > random: harvesting attach, 8 bytes (4 bits) from xbbd0 > tap0: bpf attached > tap0: Ethernet address: 00:bd:ee:99:ff:00 > tap0: link state changed to UP > tap0: changing name to 'xnb2.0-emu' > xnb(xnb_probe:1127): Claiming device 0, xnb > xnb2.0: bpf attached > xnb(xnb_attach:1271): Attaching to backend/vif/2/0 > random: harvesting attach, 8 bytes (4 bits) from xnb0 > xnb(xnb_frontend_changed:1395): frontend_state=Initialising, > xnb_state=InitWait > xnb2.0: link state changed to DOWN > xnb2.0: link state changed to UP > xnb2.0: link state changed to DOWN > xnb2.0: promiscuous mode enabled > xnb2.0: link state changed to UP > xnb2.0-emu: promiscuous mode enabled > nd6_dad_timer: cancel DAD on xnb2.0 because of ND6_IFF_IFDISABLED. > xnb(xnb_frontend_changed:1395): frontend_state=Connected, xnb_state=InitWait > xnb(xnb_connect_comms:788): rings connected! Can you please give a try to the following patch? I think it should apply cleanly to stable/11 (11.1-RELEASE). You will have to rebuild and install the kernel. Thanks, Roger. ---8<--- diff --git a/sys/dev/xen/blkback/blkback.c b/sys/dev/xen/blkback/blkback.c index 9744c8da73cb..e9c7afe7d18c 100644 --- a/sys/dev/xen/blkback/blkback.c +++ b/sys/dev/xen/blkback/blkback.c @@ -806,6 +806,9 @@ struct xbb_softc { /** Watch to wait for hotplug script execution */ struct xs_watch hotplug_watch; + + /** Got the needed data from hotplug scripts? */ + bool hotplug_done; }; /*---------------------------- Request Processing ----------------------------*/ @@ -3310,10 +3313,9 @@ xbb_connect(struct xbb_softc *xbb) { int error; - if (xenbus_get_state(xbb->dev) != XenbusStateInitialised) - return; - - if (xbb_collect_frontend_info(xbb) != 0) + if (!xbb->hotplug_done || + (xenbus_get_state(xbb->dev) != XenbusStateInitWait) || + (xbb_collect_frontend_info(xbb) != 0)) return; xbb->flags &= ~XBBF_SHUTDOWN; @@ -3412,6 +3414,7 @@ xbb_shutdown(struct xbb_softc *xbb) free(xbb->hotplug_watch.node, M_XENBLOCKBACK); xbb->hotplug_watch.node = NULL; } + xbb->hotplug_done = false; if (xenbus_get_state(xbb->dev) < XenbusStateClosing) xenbus_set_state(xbb->dev, XenbusStateClosing); @@ -3692,8 +3695,7 @@ xbb_attach_disk(struct xs_watch *watch, const char **vec, unsigned int len) return; } - /* Tell the front end that we are ready to connect. */ - xenbus_set_state(dev, XenbusStateInitialised); + xbb->hotplug_done = true; } /** @@ -3757,6 +3759,7 @@ xbb_attach(device_t dev) * We need to wait for hotplug script execution before * moving forward. */ + KASSERT(!xbb->hotplug_done, ("Hotplug scripts already executed")); watch_path = xs_join(xenbus_get_node(xbb->dev), "physical-device-path"); xbb->hotplug_watch.callback_data = (uintptr_t)dev; xbb->hotplug_watch.callback = xbb_attach_disk; From owner-freebsd-xen@freebsd.org Mon May 14 16:56:03 2018 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9F730DF9E10 for ; Mon, 14 May 2018 16:56:03 +0000 (UTC) (envelope-from pratiy0100@gmail.com) Received: from mail-wm0-x234.google.com (mail-wm0-x234.google.com [IPv6:2a00:1450:400c:c09::234]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 069B96C631 for ; Mon, 14 May 2018 16:56:03 +0000 (UTC) (envelope-from pratiy0100@gmail.com) Received: by mail-wm0-x234.google.com with SMTP id x12-v6so12547735wmc.0 for ; Mon, 14 May 2018 09:56:02 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=wnfvpjdO+WUW+7BJsWM6gJWdMCloNdGWffK+bxUz9iA=; b=XJkiFFw71ysU7HQWgx58juo4wfsw75Kg2NdM4lANK8nqM3ImoZLWkgmh3Lz/fg/lnY btXEGTlLIxe8iZj+2LX5w+koQoAwdVyBF1LGI0UTBt7hAA4O2TWZhiZl+4aXqXMaJh1H 7AHcrnxGcYtYejK4xZQydgenC3mKpgQRyprlJzsxBQhG+zkKJ1PNutAFLI4FiSbT4eMB m3xJtV9kZf7LFoo6nf6M2YPTSfc4A/2uOyway8P71Lo1x1/FnxCU0hIi06vG3UkdcIrg FwsyT0ZCA/iQFVKGv9cgpCrqKeHyeE3VrZsZsNw3COtXPer6FubqJiS40K1/ATnQYkHc VC9Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=wnfvpjdO+WUW+7BJsWM6gJWdMCloNdGWffK+bxUz9iA=; b=ndHTaoe/hTtiVnVffJBaI926+dExPv44bO2jyx+Io3E8h29ayXlfZ2fyxLUN1FCVYH HV1x8HBEMTN98ZqzFM6YT5pXYR9HDo3xUDpdUelJyIvgFt365UWWsMIqVcJ9+HLP4sSZ 3142htdKZDovUDqQ83aIqe9/7hIcxigiipYMzg1Dg8fqXfMSFiwjjP2wn3hd9EO/q6/0 6c+nTe5BY22l7n2sBMEcyvJuZSTypGvWIuglIb0fLzSFPZ/nZ3PXYxfGoPA8SATojvKi FCVWZSWSVQaD4Qcy2GA8yk0UYSfyj+jgrdrO9h9hSCrQD/4oiRxWdq5PBRSmucAw34Tz B+nQ== X-Gm-Message-State: ALKqPwfizhujAe7zFnvDEvBfyEVZFu9QW9P00+kQRFgeeKSyKLYx4j6l oGXnFk84d/2/aJP9pjH+3f8BPPiRmuANQnYGdBjnCA== X-Google-Smtp-Source: AB8JxZrJFF4L5RBSEuYbMHovnisOHE0kEdlL81obJugP0x+nXjb31jhmJcABr0buVDZgWFEjeoYNdxvZxLDZzbRos6w= X-Received: by 2002:a50:b119:: with SMTP id k25-v6mr13921874edd.217.1526316961764; Mon, 14 May 2018 09:56:01 -0700 (PDT) MIME-Version: 1.0 Received: by 10.80.170.33 with HTTP; Mon, 14 May 2018 09:55:21 -0700 (PDT) From: Pratyush Yadav Date: Mon, 14 May 2018 22:25:21 +0530 Message-ID: Subject: Is it possible to run Xen in a VirtualBox VM? To: freebsd-xen@freebsd.org Content-Type: text/plain; charset="UTF-8" X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.26 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 May 2018 16:56:03 -0000 Hi, I tried running Xen in a VirtualBox guest and it errors in the boot process giving this error: xenoprof: Initialization failed. Intel processor family 6 model 60 is not supported. Dom0 has maximum 600 PIRQs *********************** Panic on cpu 0: Error creating domain 0 *********************** So, is it even possible to run Xen in a VM? If it is, how can I fix this problem? -- Regards, Pratyush Yadav From owner-freebsd-xen@freebsd.org Mon May 14 17:00:57 2018 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 53F55DFA384 for ; Mon, 14 May 2018 17:00:57 +0000 (UTC) (envelope-from prvs=66538a94f=roger.pau@citrix.com) Received: from SMTP.EU.CITRIX.COM (smtp.ctxuk.citrix.com [185.25.65.24]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.citrix.com", Issuer "DigiCert SHA2 Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id C62146F04C for ; Mon, 14 May 2018 17:00:56 +0000 (UTC) (envelope-from prvs=66538a94f=roger.pau@citrix.com) X-IronPort-AV: E=Sophos;i="5.49,400,1520899200"; d="scan'208";a="73131494" Date: Mon, 14 May 2018 18:00:43 +0100 From: Roger Pau =?utf-8?B?TW9ubsOp?= To: Pratyush Yadav CC: Subject: Re: Is it possible to run Xen in a VirtualBox VM? Message-ID: <20180514170043.z3netvhmdmwnjmq3@MacBook-Pro-de-Roger.local> References: MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Disposition: inline In-Reply-To: User-Agent: NeoMutt/20180323 X-ClientProxiedBy: AMSPEX02CAS01.citrite.net (10.69.22.112) To AMSPEX02CL02.citrite.net (10.69.22.126) X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.26 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 May 2018 17:00:57 -0000 On Mon, May 14, 2018 at 10:25:21PM +0530, Pratyush Yadav wrote: > Hi, > > I tried running Xen in a VirtualBox guest and it errors in the boot > process giving this error: > > xenoprof: Initialization failed. Intel processor family 6 model 60 is > not supported. > Dom0 has maximum 600 PIRQs > > *********************** > Panic on cpu 0: > Error creating domain 0 > *********************** > > So, is it even possible to run Xen in a VM? If it is, how can I fix > this problem? It's likely possible to run Xen + Linux Dom0 inside of VirtualBox, but it's almost certainly not possible to run Xen + FreeBSD inside of VirtualBox because it would require an emulated IOMMU, which I don't think VirtualBox provides. Roger. From owner-freebsd-xen@freebsd.org Mon May 14 17:20:26 2018 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1DC75DFB8C6 for ; Mon, 14 May 2018 17:20:26 +0000 (UTC) (envelope-from pratiy0100@gmail.com) Received: from mail-wm0-x231.google.com (mail-wm0-x231.google.com [IPv6:2a00:1450:400c:c09::231]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 87F7B723E7 for ; Mon, 14 May 2018 17:20:25 +0000 (UTC) (envelope-from pratiy0100@gmail.com) Received: by mail-wm0-x231.google.com with SMTP id n10-v6so16596225wmc.1 for ; Mon, 14 May 2018 10:20:25 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-transfer-encoding; bh=ro7AWz38wj4b3Oi39LcmrPox3FQogPmAwMrHyMQIR5I=; b=jbcZxCFkloX6EVP6k88rlEzR8nB9WmIbpArCr9L9bhdZ/YHu4XIRXqZIx1/2IzVHL+ vsLV5CqVP3WLfqQ2pfglnD64bSPirBRV93FPBj/7G1+962TB4rl80XzNjzvJeI2SiiHn 7WZVyw+HERR8JidgmaMVUoOCugPl9nySl1pu5kh2SLKWSxu+GE09jNwXDJXLzjqtNnoR dkc+2wblThfglGIorT+3UVS0u6SLpr1800KbjfBfHPjMdkiY8YXIWAj7ZyZtE5MhZ0l6 DZUFogfiPqFWZjNJtvE9fM/qhopmrkPJ0g/JU3f6sY3rSwMoh3gbUCw4OYlDfhWVEM3q Xsmg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=ro7AWz38wj4b3Oi39LcmrPox3FQogPmAwMrHyMQIR5I=; b=uaNKIot3cULO7TSWxBCobFnVYiZMsaEPEKaQHvBZHuAKonuPdjeCoCj+fwpHnX8G+O F8DN2oLtRQhXcBJ6mwZvKXnuf9yIlBxkPUU3QRT+IErfYFO6al7BBjj47U7QSz5XwBJ3 dUtv+13Qky+LoxCjSIczGy6CEdnWbR/vuP3LyooEyBIQeqpA9c91fki0jRxWGTJQGNs+ GTN+OndnhT8+2dYj58RiqcSbsTi7yakYEdNgKn45FrYsTrfR41w9jIbQ8kKPdnuN7xfW Z2KadCmJ3XzAJCwXekbsP1APf8CGXsvs0a/PJVAAy84cS2rPhOVOBwQwLaS3ZrqbgF/P 3Eqw== X-Gm-Message-State: ALKqPwevksCzGoN2RlaF7fARgh6r5uFlK0Je7pkvRREqIN5JLLDTEdW4 CEn4Bq8bNrB3P/SfKkDZPNjmvWIjwF+X3W+JZLxVlx/G X-Google-Smtp-Source: AB8JxZpwBx2r9/Y9dysgJs9h/kT30aXguD/EOg4y0KsKVo7Z/SzMhIVZwNdTS2qV8lLBnfLsS5vzniwgBZOVkPI0RhU= X-Received: by 2002:a50:ad69:: with SMTP id z38-v6mr13840080edc.306.1526318424147; Mon, 14 May 2018 10:20:24 -0700 (PDT) MIME-Version: 1.0 Received: by 10.80.170.33 with HTTP; Mon, 14 May 2018 10:19:43 -0700 (PDT) In-Reply-To: <20180514170043.z3netvhmdmwnjmq3@MacBook-Pro-de-Roger.local> References: <20180514170043.z3netvhmdmwnjmq3@MacBook-Pro-de-Roger.local> From: Pratyush Yadav Date: Mon, 14 May 2018 22:49:43 +0530 Message-ID: Subject: Re: Is it possible to run Xen in a VirtualBox VM? To: =?UTF-8?Q?Roger_Pau_Monn=C3=A9?= Cc: freebsd-xen@freebsd.org Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.26 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 May 2018 17:20:26 -0000 On Mon, May 14, 2018 at 10:30 PM, Roger Pau Monn=C3=A9 wrote: > On Mon, May 14, 2018 at 10:25:21PM +0530, Pratyush Yadav wrote: >> Hi, >> >> I tried running Xen in a VirtualBox guest and it errors in the boot >> process giving this error: >> >> xenoprof: Initialization failed. Intel processor family 6 model 60 is >> not supported. >> Dom0 has maximum 600 PIRQs >> >> *********************** >> Panic on cpu 0: >> Error creating domain 0 >> *********************** >> >> So, is it even possible to run Xen in a VM? If it is, how can I fix >> this problem? > > It's likely possible to run Xen + Linux Dom0 inside of VirtualBox, but > it's almost certainly not possible to run Xen + FreeBSD inside of > VirtualBox because it would require an emulated IOMMU, which I don't > think VirtualBox provides. I am working on the Xen grant table handlers (for my Google Summer of Code project [0]) , so do you think I would need to run Xen + FreeBSD when testing? Also, how can I fix the error I'm currently getting about Intel processor not being supported? --=20 Regards, Pratyush Yadav [0] https://summerofcode.withgoogle.com/projects/#6165033877241856 From owner-freebsd-xen@freebsd.org Mon May 14 17:55:16 2018 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 02B72DFD669 for ; Mon, 14 May 2018 17:55:16 +0000 (UTC) (envelope-from prvs=66538a94f=roger.pau@citrix.com) Received: from SMTP.EU.CITRIX.COM (smtp.ctxuk.citrix.com [185.25.65.24]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.citrix.com", Issuer "DigiCert SHA2 Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 70B747BEC1 for ; Mon, 14 May 2018 17:55:14 +0000 (UTC) (envelope-from prvs=66538a94f=roger.pau@citrix.com) X-IronPort-AV: E=Sophos;i="5.49,400,1520899200"; d="scan'208";a="73133919" Date: Mon, 14 May 2018 18:55:05 +0100 From: Roger Pau =?utf-8?B?TW9ubsOp?= To: Pratyush Yadav CC: Subject: Re: Is it possible to run Xen in a VirtualBox VM? Message-ID: <20180514175505.ol4opdvdpkghx2zi@MacBook-Pro-de-Roger.local> References: <20180514170043.z3netvhmdmwnjmq3@MacBook-Pro-de-Roger.local> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: User-Agent: NeoMutt/20180323 X-ClientProxiedBy: AMSPEX02CAS01.citrite.net (10.69.22.112) To AMSPEX02CL02.citrite.net (10.69.22.126) X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.26 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 May 2018 17:55:16 -0000 On Mon, May 14, 2018 at 10:49:43PM +0530, Pratyush Yadav wrote: > On Mon, May 14, 2018 at 10:30 PM, Roger Pau Monné wrote: > > On Mon, May 14, 2018 at 10:25:21PM +0530, Pratyush Yadav wrote: > >> Hi, > >> > >> I tried running Xen in a VirtualBox guest and it errors in the boot > >> process giving this error: > >> > >> xenoprof: Initialization failed. Intel processor family 6 model 60 is > >> not supported. > >> Dom0 has maximum 600 PIRQs > >> > >> *********************** > >> Panic on cpu 0: > >> Error creating domain 0 > >> *********************** > >> > >> So, is it even possible to run Xen in a VM? If it is, how can I fix > >> this problem? > > > > It's likely possible to run Xen + Linux Dom0 inside of VirtualBox, but > > it's almost certainly not possible to run Xen + FreeBSD inside of > > VirtualBox because it would require an emulated IOMMU, which I don't > > think VirtualBox provides. > > I am working on the Xen grant table handlers (for my Google Summer of > Code project [0]) , so do you think I would need to run Xen + FreeBSD > when testing? Yes, I think you will need to be able to run Xen + FreeBSD. You can probably manage to complete the first part using Xen + Linux and running FreeBSD as a guest, but you will need Xen + FreeBSD Dom0 for the second part (adding handlers for mapping operations used by the backend). > Also, how can I fix the error I'm currently getting about Intel > processor not being supported? Which error? Can you please paste the full log? Roger. From owner-freebsd-xen@freebsd.org Tue May 15 02:34:58 2018 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 767A4EB1F7E for ; Tue, 15 May 2018 02:34:58 +0000 (UTC) (envelope-from nathan.friess@gmail.com) Received: from mail-pg0-x22e.google.com (mail-pg0-x22e.google.com [IPv6:2607:f8b0:400e:c05::22e]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id EE7947A111; Tue, 15 May 2018 02:34:57 +0000 (UTC) (envelope-from nathan.friess@gmail.com) Received: by mail-pg0-x22e.google.com with SMTP id l2-v6so6307277pgc.7; Mon, 14 May 2018 19:34:57 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=subject:to:cc:references:from:message-id:date:user-agent :mime-version:in-reply-to:content-language; bh=XtBIjZ3KT8GXBlthLRfC/HiaSOZFwHt9zLnKiIvH0yI=; b=KpRnUs5fU0RUP8CUHh15/Z5F9+waPhoebtGPGl5MmGTq+XZMkx5F5jaM23JDiFfadr kvNYK91cWh+Yyav5QjsuBxIzQNHyONVlVTbg5wF7//m6xL7SBX5KLczQW9ZLMQ7tXXkJ ZmWnRoR/Rl9AhCC3mT+ugRQKIAg6E1JKahK1RLFo6LMAIWyMzbvMaCb6p4QlZwoeyY8k DdNX6NYN9xpCX4gI9IH7ywe+O+btA6sSZng4KpMsJavZP8tcActxbqBWfLBVN5RTS0hY PwDCFrQGyVrnobzZhMgMs5Hc0+TQBM3UtKFCECzuqUS5RZINUC3PB81Wq8K08qaagc0d Pbyw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:cc:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-language; bh=XtBIjZ3KT8GXBlthLRfC/HiaSOZFwHt9zLnKiIvH0yI=; b=gNbF1Uuh18RvRf2mTQhVnBy1VhbzwAVt5QlzrZZe2IbFPUdUaMElbrH0Vl3retGPMn GvrxguMTqXUGtx8Zi6v6qXEivVUB356CZ7S83jy5zA/vqRuzqS5hQ0K6ck1SS4BZZ2gB cUyI0lNeT8wTdB7HtHCFknr4woDoFVrKJeaMlsTtQtfA5nyeTtNaoNhj1qA1A915zGl6 f462QK4XTUCN8tE7plf37HhV2iqvM5X99UDP+PhErBMj/3Vf3GqhQexlllp7RRZIttZm AsVvF5xMScYnZlPJzbeUMeocv5f2btGRiKS2WTWt1kuI27CALIjfSkvqyiK1xn3D7QR0 W/Gg== X-Gm-Message-State: ALKqPwcOSVhB2cxnTfJTxwMXbUMWDvFHyPJb1KtDlzPyOTEvJZ7IDvTB USa4gx0OzPygkAGZ/5tLdYLSniMR X-Google-Smtp-Source: AB8JxZqRDwQLQVxEjSzPbf2qcTbHzm9YC1XdYyptuRBpu+E0OUWvX5M1Q8DHbHK16CN2wk6EVjdkkg== X-Received: by 2002:a63:302:: with SMTP id 2-v6mr10317941pgd.98.1526351696765; Mon, 14 May 2018 19:34:56 -0700 (PDT) Received: from [10.2.1.1] (S01060018e7c4b870.cg.shawcable.net. [70.72.182.108]) by smtp.gmail.com with ESMTPSA id f4-v6sm6564064pgo.77.2018.05.14.19.34.55 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Mon, 14 May 2018 19:34:56 -0700 (PDT) Subject: Re: Linux domU only works with xen_platform_pci=0 ? To: =?UTF-8?Q?Roger_Pau_Monn=c3=a9?= , Kai Otto Cc: freebsd-xen@freebsd.org References: <20180513151649.4ls73myegkhm3cep@MacBook-Pro-de-Roger.local> <0749df4b-1614-dcdf-1bf2-1bbad1ae5743@duckster.net> <20180514130445.ahqk5ol3kdhriqju@MacBook-Pro-de-Roger.local> From: Nathan Friess Message-ID: <6c0e1f5a-3e7d-054e-298c-5ec3d97e6141@gmail.com> Date: Mon, 14 May 2018 20:34:54 -0600 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.6.0 MIME-Version: 1.0 In-Reply-To: <20180514130445.ahqk5ol3kdhriqju@MacBook-Pro-de-Roger.local> Content-Type: multipart/mixed; boundary="------------E874B936718ADF8811C4B06C" Content-Language: en-US X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.26 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 15 May 2018 02:34:58 -0000 This is a multi-part message in MIME format. --------------E874B936718ADF8811C4B06C Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit On 2018-05-14 07:04 AM, Roger Pau Monné wrote: > On Sun, May 13, 2018 at 07:33:03PM +0200, Kai Otto wrote: >> On 13/05/18 17:16, Roger Pau Monné wrote: >>> On Sun, May 13, 2018 at 03:51:36PM +0200, Kai Otto wrote: >>>> Hello, >>>> >>>> I'm trying to set up a FreeBSD 11.1 system as Xen virtualization host. >>>> Following a combination of handbook [1] and wiki [2], I was able to get >>>> get a FreeBSD dom0 in PVH mode, and FreeBSD domU in HVM mode running, >>>> including installation to disk and networking. >>>> >>>> It seemed to me as if the switch 'xen_platform_pci' doesn't have an >>>> effect on FreeBSD domU's, as I see e.g. a xenpci0 and xbd0 in dmesg no >>>> matter if I set it to 1 or 0. >>>> >>>> Do I understand it correctly, that this switch makes the difference >>>> between HVM and PVHVM mode? >>>> According to xl.cfg(5), it 'enables a guest Operating System [...] to >>>> make use of paravirtualization features such as disk and network devices'. >>>> >>>> >>>> Afterwards, I tried to create a Linux domU. Both Centos 7 and Alpine >>>> Linux only detected the harddisk with xen_platform_pci=0. >>>> >>>> For Alpine Linux, with xen_platform_pci=1, I get the following messages >>>> on the console: >>>> >>>> vbd vbd-5632: 19 xenbus_dev_probe on device/vbd/5632 >>> That's ENODEV IIRC, I think there's something wrong with FreeBSD disk >>> backend. >>> >>>> vbd vbd-5632: failed to write error node for device/vbd/5632 (19 >>>> xenbus_dev_probe on device/vbd/5632) >>>> >>>> After waiting for a couple minutes it boots, but doesn't detect the disk. I had similar issues with Linux domUs being unable to detect their disks when FreeBSD 11.1-RELEASE is the backend: https://lists.freebsd.org/pipermail/freebsd-xen/2016-December/002924.html What seems to be happening is that on my system the frontend and backend may go from state InitWait to Initialised in different orders and so either end may end up getting stuck waiting for the other side to change state when the other side already has done so. I have been running with the attached patch since my last message above and Linux domUs have been working perfectly since then. I realize that the call to pause() is not the correct solution but it demonstrates that some fine tuning of how the states are handled will help. Nathan --------------E874B936718ADF8811C4B06C Content-Type: text/x-patch; name="missed-notifications.patch" Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename="missed-notifications.patch" Index: sys/dev/xen/blkback/blkback.c =================================================================== --- sys/dev/xen/blkback/blkback.c (revision 321598) +++ sys/dev/xen/blkback/blkback.c (working copy) @@ -3692,6 +3692,11 @@ /* Tell the front end that we are ready to connect. */ xenbus_set_state(dev, XenbusStateInitialised); + + /* The front end may have finished first, so we should proceed as well. */ + if (xenbus_get_otherend_state(xbb->dev) == XenbusStateInitialised) { + xbb_connect(xbb); + } } /** @@ -3769,6 +3774,14 @@ return (error); } + /* + * We may need to wait for Linux frontend to become ready + * so it will not miss us going into InitWait. + */ + if (xenbus_get_otherend_state(xbb->dev) != XenbusStateInitialising) { + pause("xbb_attach", 100); + } + /* Tell the toolstack blkback has attached. */ xenbus_set_state(dev, XenbusStateInitWait); --------------E874B936718ADF8811C4B06C-- From owner-freebsd-xen@freebsd.org Tue May 15 06:08:25 2018 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 536D2EE0223 for ; Tue, 15 May 2018 06:08:25 +0000 (UTC) (envelope-from pratiy0100@gmail.com) Received: from mail-wm0-x236.google.com (mail-wm0-x236.google.com [IPv6:2a00:1450:400c:c09::236]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id A6494693F6 for ; Tue, 15 May 2018 06:08:24 +0000 (UTC) (envelope-from pratiy0100@gmail.com) Received: by mail-wm0-x236.google.com with SMTP id a8-v6so17185737wmg.5 for ; Mon, 14 May 2018 23:08:24 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-transfer-encoding; bh=HR8PCbPeRt6XA3dPJok9poSfvJ7R7+jJlnQ0t0tJ0Oo=; b=URfsQfpC3WMvuc2qV9Tl6zmTpxiHQzBAfSMofQyazVPZYsFy6NW0BlSWf7ukCpql+2 ByO8FMaV96OeBVfMdbZfskjG4U+nXEqjEjD166+unc/Coy12EWDLSZnXdhhfvtVxfKva KJMx3QAxA6TrBMBLsOjjd2KWgQ+YU59Mydr+4+cysod1eWk7RxaSFbP38IvSpQ1B/3Ml enb7+FrM9//H8zTvsQv8EpKrpWi873mByDvy+ipzkPuSIDBd7Kk6WfG6kLAqdmjG5mTf 9f/OuAyc7KnoSTe6SSzvXvjmgJHwW8OEwL/F8ky58Dl7yO29YaRL8FhZCtFu5pW4Q6hg I3AQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=HR8PCbPeRt6XA3dPJok9poSfvJ7R7+jJlnQ0t0tJ0Oo=; b=iWkbeJf9HojqZ/mUrJMMfyeZ7U3rkndzs2X/Wyaqx9l72AkGyiXniw+7L0WR9Qm6dh 2vOJuYfzn1+VAeLK6X7T987mlj/weTE/NsXFFGMAQN9KvL8q/kQLHSkSr/BUzQAf7q3x GwhwBCmao3ExlTLi532NfD7utWA4IojvS/M9hZR+S3RCy1kqRs1NK/T4+vt6t3PVWfS1 96s/blJL6ojgkxhZ848IXznqwRM0+RtcE4zW/ij6O0jQj0PXqO+7TAsEYinj7UVBL/yF UfjqDkTwrXXxoQIUy+DMqC9ZuzMFCnkPlqe4N5QImeuDycLQYK1al976emilVndYF68C A9Dw== X-Gm-Message-State: ALKqPwcTMNZhmoGMPSfUc4tENJ/fOa1rpek4f/tmRFJh5GLW6jPgazjL KA1Vullx/0/4ajSwBmirQic+30CPkj0udQpkL50= X-Google-Smtp-Source: AB8JxZollU7CVD9NG15LNvqNaTDXZaQD8lWpF7Qxk8CrX5q14h/NZGmkPftuRKYB3xxCBT9rl6MNNvkNuo33zP9rwFk= X-Received: by 2002:a50:f5cd:: with SMTP id x13-v6mr15878848edm.132.1526364503402; Mon, 14 May 2018 23:08:23 -0700 (PDT) MIME-Version: 1.0 Received: by 10.80.170.33 with HTTP; Mon, 14 May 2018 23:07:43 -0700 (PDT) In-Reply-To: <20180514175505.ol4opdvdpkghx2zi@MacBook-Pro-de-Roger.local> References: <20180514170043.z3netvhmdmwnjmq3@MacBook-Pro-de-Roger.local> <20180514175505.ol4opdvdpkghx2zi@MacBook-Pro-de-Roger.local> From: Pratyush Yadav Date: Tue, 15 May 2018 11:37:43 +0530 Message-ID: Subject: Re: Is it possible to run Xen in a VirtualBox VM? To: =?UTF-8?Q?Roger_Pau_Monn=C3=A9?= Cc: freebsd-xen@freebsd.org Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.26 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 15 May 2018 06:08:25 -0000 On Mon, May 14, 2018 at 11:25 PM, Roger Pau Monn=C3=A9 wrote: > On Mon, May 14, 2018 at 10:49:43PM +0530, Pratyush Yadav wrote: >> I am working on the Xen grant table handlers (for my Google Summer of >> Code project [0]) , so do you think I would need to run Xen + FreeBSD >> when testing? > > Yes, I think you will need to be able to run Xen + FreeBSD. You can > probably manage to complete the first part using Xen + Linux and > running FreeBSD as a guest, but you will need Xen + FreeBSD Dom0 for > the second part (adding handlers for mapping operations used by the > backend). >> Also, how can I fix the error I'm currently getting about Intel >> processor not being supported? > > Which error? Can you please paste the full log? > > Roger. Ah, my bad. I misread your message. I thought you were saying we can run Xen + FreeBSD Dom0 but not a FreeBSD DomU. Anyway, I can't get the logs because they are not outputting to the serial port for some reason. I wrote what I could read from the 5 seconds I get before the reboot in my first email. You answered my question, but if you want a look at the error message I could read, check my first email. I'll also paste it below [0]. Thanks for your help. --=20 Regards, Pratyush Yadav [0]: xenoprof: Initialization failed. Intel processor family 6 model 60 is not supported. Dom0 has maximum 600 PIRQs *********************** Panic on cpu 0: Error creating domain 0 *********************** From owner-freebsd-xen@freebsd.org Tue May 15 06:55:21 2018 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D3C47EE320B for ; Tue, 15 May 2018 06:55:21 +0000 (UTC) (envelope-from pratiy0100@gmail.com) Received: from mail-wm0-x22b.google.com (mail-wm0-x22b.google.com [IPv6:2a00:1450:400c:c09::22b]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4E0FA74AEF for ; Tue, 15 May 2018 06:55:21 +0000 (UTC) (envelope-from pratiy0100@gmail.com) Received: by mail-wm0-x22b.google.com with SMTP id m129-v6so19277114wmb.3 for ; Mon, 14 May 2018 23:55:21 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-transfer-encoding; bh=s2Yljfst+GilR49yixKdlBqedYGD35VL/JRsJ1YPf+4=; b=k1KQiUiiHgCoCWNpo5CLDlO+TsrOVBQb3f8qfxPEa47EAmcWX/AS3k58rb/BNW5Mo0 0K3h3WU3W6ZF7s7FAwOx05rcb0ulUm/w19C3rn9w/E9kAT+z+6/wirfiaLYJjF0JEiQC xe+qEV2FHscCILnfjSK4vVAHYqn3dn4mC7LgbqPn9CS64HjjcwuItIpGP/g8ew2Y6nHy YhuZmsYnw6UMVUaTxLWzpHwXcvnxsNMEGI6yqN3wY00biKtG+VfUTHocl1Bhf8Zocfxh nQKbjEcEHLt6C/mYK0JLblBbLgAkb4kCMzkqwPqbVEWvhCl73C+p77kDUjA/7v/F8QlN ZwAg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=s2Yljfst+GilR49yixKdlBqedYGD35VL/JRsJ1YPf+4=; b=scmGbPd1B3GgzRPgcgzz9fBj+pZupa4iSGglfZvypDn/sBULHAw/KsSzozCIVo5Vm+ osMOjVAyhNnsdGnAYJ1cKrIHnfDsNiJJTPI5lD7051VMMYOJ7yYW194mfxR+2g2ab9bw wB48frcF0T1ISxlhAJyongQoi+ExBt3dYw8mghc/Pg12rKRsgM/qZk6maP0iDwTfSKj6 E4V6Xx8R3MdPB9m+WODUQA6snswjx6Dvq5hUzxYptb4VAAo4o46Ut7CyahhZTAUlFEiz 03nuUP2yNGhQiBE2P6qXnjGbRommLaMQs10xdmKwx6HC8wPwWb5yHJYNshuCfRVFayGq DWHg== X-Gm-Message-State: ALKqPweW768nbjRiOkCH9M34e3JM1z+NqsQG3zgStiGYTnPm9KD/h+PR FiPph4ixAW+GtWUmZlVTnyZ7ceYDM3l1fyF8m5M= X-Google-Smtp-Source: AB8JxZrkulc3vGTFOZjjbQDUp0e33gHXzP7sPM6pYlOFOySPUsUOQtzxnj9kf8zI/gnu9pa8i8YRyJztc5y8cdJjuys= X-Received: by 2002:a50:b119:: with SMTP id k25-v6mr16681228edd.217.1526367320277; Mon, 14 May 2018 23:55:20 -0700 (PDT) MIME-Version: 1.0 Received: by 10.80.170.33 with HTTP; Mon, 14 May 2018 23:54:40 -0700 (PDT) In-Reply-To: References: <20180514170043.z3netvhmdmwnjmq3@MacBook-Pro-de-Roger.local> <20180514175505.ol4opdvdpkghx2zi@MacBook-Pro-de-Roger.local> From: Pratyush Yadav Date: Tue, 15 May 2018 12:24:40 +0530 Message-ID: Subject: Re: Is it possible to run Xen in a VirtualBox VM? To: =?UTF-8?Q?Roger_Pau_Monn=C3=A9?= Cc: freebsd-xen@freebsd.org Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.26 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 15 May 2018 06:55:22 -0000 On Mon, May 14, 2018 at 11:25 PM, Roger Pau Monn=C3=A9 wrote: > Yes, I think you will need to be able to run Xen + FreeBSD. You can > probably manage to complete the first part using Xen + Linux and > running FreeBSD as a guest, but you will need Xen + FreeBSD Dom0 for > the second part (adding handlers for mapping operations used by the > backend). One more thing, is there any other VM like VirtualBox that can run Xen + FreeBSD as Dom0, or do I have to run it on a different computer. Thanks, Pratyush Yadav From owner-freebsd-xen@freebsd.org Tue May 15 07:07:00 2018 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B99A4EE3D8A for ; Tue, 15 May 2018 07:07:00 +0000 (UTC) (envelope-from saper@saper.info) Received: from m.saper.info (m.saper.info [IPv6:2a01:4f8:a0:7383::]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "saper.info", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4AEC0759C8 for ; Tue, 15 May 2018 07:07:00 +0000 (UTC) (envelope-from saper@saper.info) Received: from m.saper.info (saper@localhost [127.0.0.1]) by m.saper.info (8.15.2/8.15.2) with ESMTPS id w4F76n67045356 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Tue, 15 May 2018 07:06:50 GMT (envelope-from saper@saper.info) Received: from localhost (saper@localhost) by m.saper.info (8.15.2/8.15.2/Submit) with ESMTP id w4F76nE7045353; Tue, 15 May 2018 07:06:49 GMT (envelope-from saper@saper.info) X-Authentication-Warning: m.saper.info: saper owned process doing -bs Date: Tue, 15 May 2018 07:06:49 +0000 From: Marcin Cieslak To: Pratyush Yadav cc: =?ISO-8859-15?Q?Roger_Pau_Monn=E9?= , freebsd-xen@freebsd.org Subject: Re: Is it possible to run Xen in a VirtualBox VM? In-Reply-To: Message-ID: References: <20180514170043.z3netvhmdmwnjmq3@MacBook-Pro-de-Roger.local> <20180514175505.ol4opdvdpkghx2zi@MacBook-Pro-de-Roger.local> MIME-Version: 1.0 Content-Type: multipart/signed; protocol="application/pkcs7-signature"; micalg=sha-256; boundary="1563967779-129764394-1526368009=:44112" X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.26 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 15 May 2018 07:07:01 -0000 --1563967779-129764394-1526368009=:44112 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8BIT On Tue, 15 May 2018, Pratyush Yadav wrote: > On Mon, May 14, 2018 at 11:25 PM, Roger Pau Monné wrote: > > Yes, I think you will need to be able to run Xen + FreeBSD. You can > > probably manage to complete the first part using Xen + Linux and > > running FreeBSD as a guest, but you will need Xen + FreeBSD Dom0 for > > the second part (adding handlers for mapping operations used by the > > backend). > > One more thing, is there any other VM like VirtualBox that can run Xen > + FreeBSD as Dom0, or do I have to run it on a different computer. I have solved this problem for me by renting a physical server at the hosting company. But serious hacking requires having access to the physical console (most hosting providers provide something like that). I don't know how others are working on this? Anyone running Xen on their laptop for example? Marcin --1563967779-129764394-1526368009=:44112 Content-Type: application/pkcs7-signature; name=smime.p7s Content-Transfer-Encoding: BASE64 Content-Description: S/MIME Cryptographic Signature Content-Disposition: attachment; filename=smime.p7s MIIOSwYJKoZIhvcNAQcCoIIOPDCCDjgCAQExDzANBglghkgBZQMEAgEFADAL BgkqhkiG9w0BBwGgggqQMIIElzCCA3+gAwIBAgIOSBtqCKJEiNNcmz3JSA0w DQYJKoZIhvcNAQELBQAwTDEgMB4GA1UECxMXR2xvYmFsU2lnbiBSb290IENB IC0gUjMxEzARBgNVBAoTCkdsb2JhbFNpZ24xEzARBgNVBAMTCkdsb2JhbFNp Z24wHhcNMTYwNjE1MDAwMDAwWhcNMjQwNjE1MDAwMDAwWjBdMQswCQYDVQQG EwJCRTEZMBcGA1UEChMQR2xvYmFsU2lnbiBudi1zYTEzMDEGA1UEAxMqR2xv YmFsU2lnbiBQZXJzb25hbFNpZ24gMSBDQSAtIFNIQTI1NiAtIEczMIIBIjAN BgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAyrCba00KOKyGuwh9h+/MAcZm ZUF9OxGKA56AADHaDE08rB0WEbgm6J4XvJP3OGQ7cgHdVJu6XMZkRd6EcfjD yRrIwE6oAVWJe57co3gKk/XxvuubSZuUahrcOiv3D2qaHwva4zumubxQQI4f unEzRIJHPiNjaq0cCcZsMcp5pxsEz8aG0sr8Oh80sxKNnzPmuUETLESktfMC pQKHUGmWXLsG6sgCZOezUjDjKpPKW7l4PUt0TEBEyqLhifv9/YPn5C4o10PP daDazZPeKNif2PVQ5u0HRnkFrHh4wmmrMtY22Mse3eR01gD6rEEGWf+gdzuy EQE+ZVlNhCP4gXjdBQIDAQABo4IBZDCCAWAwDgYDVR0PAQH/BAQDAgEGMCcG A1UdJQQgMB4GCCsGAQUFBwMCBggrBgEFBQcDBAYIKwYBBQUHAwkwEgYDVR0T AQH/BAgwBgEB/wIBADAdBgNVHQ4EFgQUlifCwqX3HPgCenpkr2NvMtKYwrEw HwYDVR0jBBgwFoAUj/BLf6guRSSuTVD6Y5qL3uLdG7wwPgYIKwYBBQUHAQEE MjAwMC4GCCsGAQUFBzABhiJodHRwOi8vb2NzcDIuZ2xvYmFsc2lnbi5jb20v cm9vdHIzMDYGA1UdHwQvMC0wK6ApoCeGJWh0dHA6Ly9jcmwuZ2xvYmFsc2ln bi5jb20vcm9vdC1yMy5jcmwwWQYDVR0gBFIwUDALBgkrBgEEAaAyASgwQQYJ KwYBBAGgMgFfMDQwMgYIKwYBBQUHAgEWJmh0dHBzOi8vd3d3Lmdsb2JhbHNp Z24uY29tL3JlcG9zaXRvcnkvMA0GCSqGSIb3DQEBCwUAA4IBAQCxh3ekjKKy RrUdfI6D1U7qUggdFLksiU+KiIqJzJG6GXcQ2KiBy2tF3+KYb0IixXMpIVli VXlcD5Vh4tiMxJ4WONMFt3f7/53gSXLf24WMwErubc+mGMzgUGE5HKC98PcK UV/5pPggQdzPxCBNeiXnLU1tCGYhPatFTDhUBGaVhBeuUCbgR9gpXJ9guqrD OVwouKvovdIeI5KEAcoAAiSL6naeLk/GbKUaBFa2RxXC17e+YyBWtWlWDEM3 1V8pUIx76lkO8IJYREhLcg/LnyoYy5wcrzI6pbX2vw1x/jR3GHSC1AEdoqbE xui2XLLlSa6y9yQNgdkPz7GTLmpwIT+dMIIF8TCCBNmgAwIBAgIMGk4Oe/1h 2+wMOby/MA0GCSqGSIb3DQEBCwUAMF0xCzAJBgNVBAYTAkJFMRkwFwYDVQQK ExBHbG9iYWxTaWduIG52LXNhMTMwMQYDVQQDEypHbG9iYWxTaWduIFBlcnNv bmFsU2lnbiAxIENBIC0gU0hBMjU2IC0gRzMwHhcNMTcwNTI1MDg0NDE2WhcN MjAwNTI1MDg0NDE2WjA8MRkwFwYDVQQDDBBzYXBlckBzYXBlci5pbmZvMR8w HQYJKoZIhvcNAQkBFhBzYXBlckBzYXBlci5pbmZvMIICIjANBgkqhkiG9w0B AQEFAAOCAg8AMIICCgKCAgEA2sO3aQNus/oe4ZBZ4fu1Y1mzxnUYAkb4k/dw gMFc2Kd0eRoOY0AHj4rTEi/vVzzizxjLbEwXzQ9cBEAu/PqS8WsOmhZXtlfi szPDmP7ZpOwmNTWKSd9O7jHu9uTCGfEOsocQNYH2ULD1gVFkgKb8jHf+3u9d uCzh6qMomTtwLrCGEP70Lq385xUzRaD6qbOeIB99tpzgvMR6Z0GPTt4z8tLM kfdtohq5llwZ5vYnj/hJohVS9iLMQMHW4nuLj/mLZNaYE1CWJBT1rBwn5YPJ uR6811O9eAP7aX4iG8k1jkiBh+QNgGRBIK4GIdqy7IVRhA7v2OlpLYHMk4zP 9Fs3M+56QromVKBnxfzLhuYMUK6ugj9jwskNVitqlEFUeyfgvmR1jnPRp1Nd XGJllTNwGicR8wkaRj14RxfrvTZfwXs8OBODKFupqun/tNzdpOgyHMGQACss 9yv2SnLGCJvJK3rGIdRZEiUhLZH/Ct4L92dBhev+SjUqWKbHb4yIlGMgLdoh nwqatuWw7iyOeInjcinX7ghiIKDWhulUN493Fzl6kaUBtIIcrb7jzZ2pHAQT WUmuVnCTHk6NtoWB09lvuK77fw4GfxLWDFWkBQiJYPVBrmxlrkCKzrWdTMfS W9BiEC10jT1sSimUBIjDz22RkfsApeBJoAIWjiOZogILu9MCAwEAAaOCAdAw ggHMMA4GA1UdDwEB/wQEAwIFoDCBngYIKwYBBQUHAQEEgZEwgY4wTQYIKwYB BQUHMAKGQWh0dHA6Ly9zZWN1cmUuZ2xvYmFsc2lnbi5jb20vY2FjZXJ0L2dz cGVyc29uYWxzaWduMXNoYTJnM29jc3AuY3J0MD0GCCsGAQUFBzABhjFodHRw Oi8vb2NzcDIuZ2xvYmFsc2lnbi5jb20vZ3NwZXJzb25hbHNpZ24xc2hhMmcz MEwGA1UdIARFMEMwQQYJKwYBBAGgMgEoMDQwMgYIKwYBBQUHAgEWJmh0dHBz Oi8vd3d3Lmdsb2JhbHNpZ24uY29tL3JlcG9zaXRvcnkvMAkGA1UdEwQCMAAw RAYDVR0fBD0wOzA5oDegNYYzaHR0cDovL2NybC5nbG9iYWxzaWduLmNvbS9n c3BlcnNvbmFsc2lnbjFzaGEyZzMuY3JsMBsGA1UdEQQUMBKBEHNhcGVyQHNh cGVyLmluZm8wHQYDVR0lBBYwFAYIKwYBBQUHAwIGCCsGAQUFBwMEMB0GA1Ud DgQWBBReBINaGUKUo7HCrIjsKLKERu6ooTAfBgNVHSMEGDAWgBSWJ8LCpfcc +AJ6emSvY28y0pjCsTANBgkqhkiG9w0BAQsFAAOCAQEAC0VK968ySq/6B+Kd ecjVThQOKtVXuG17Krfk0xz7OPYR/V+qZtBFm2Uc6tkUEmAmq3Tyf+SE3TTX Q58eJFq0uCTUhIY714ioJs1uVWBz8rPyJ3swkOfDaUXUxkQsBsf73VfKjUk4 kB5MTrApLYUe35NmEY3FqyyX13elhW1tp864vOKM2Git61cYoRn/bwd/z2JM Zkxwkd5JgvmM+p4Da+WO4CUsGzdrZEH8X/8NQIzWtUDIh7VEQZFX5fot/KvH Am8AajtpmNqTfMyg6LfcfJUXSFqXn/KEWu4Td62vX6Pd70dYKUZxnLwYvGqG A4Ktrp9zyrUzxLbmdaPln7CstjGCA38wggN7AgEBMG0wXTELMAkGA1UEBhMC QkUxGTAXBgNVBAoTEEdsb2JhbFNpZ24gbnYtc2ExMzAxBgNVBAMTKkdsb2Jh bFNpZ24gUGVyc29uYWxTaWduIDEgQ0EgLSBTSEEyNTYgLSBHMwIMGk4Oe/1h 2+wMOby/MA0GCWCGSAFlAwQCAQUAoIHkMBgGCSqGSIb3DQEJAzELBgkqhkiG 9w0BBwEwHAYJKoZIhvcNAQkFMQ8XDTE4MDUxNTA3MDY0OVowLwYJKoZIhvcN AQkEMSIEIJvEhWqmb7QkwPCsmPTLShZVBZYIbmP63NK2MC4xRsK4MHkGCSqG SIb3DQEJDzFsMGowCwYJYIZIAWUDBAEqMAsGCWCGSAFlAwQBFjALBglghkgB ZQMEAQIwCgYIKoZIhvcNAwcwDgYIKoZIhvcNAwICAgCAMA0GCCqGSIb3DQMC AgFAMAcGBSsOAwIHMA0GCCqGSIb3DQMCAgEoMA0GCSqGSIb3DQEBAQUABIIC ABkZWVLEviFDltJLjqXBUaZy2qiWxpCw/VUhKdC7beMMZAu62TCkk9epkgh0 7mUk4GrQD0z/C7z9dAkNFuyeJDhSTDp2QaSUia45YWxK4xoGsydyubZFJocn ObiGn5NbzmwugQfKD7IcnDC4vUAvAKcREYcP4DlmurJaORXPPI+6X6CQgm61 eyO+vQ8XrBLNTlf54N2b9QV5E8x3wQ0cR2nQd67CzPm8gp7X87z+saS7RHQi kSokCnpR+0WwOifOyjAE2oS6OIvODMTNoHqqkYB4PQ6F7jHGuXJ+FEsQUNM0 jdXDIAwGAqkSAWdrSUEzT0bBN5+Z5Caxrc07tWrVlGzMl/byOGuJKW3f5Gq+ mGRzY7ui7476gNPz1pHOBq6CBLvfKDxF4FpYUCCrFvYARoWJFXfYZxZOTor4 ltnBBvz6cu9NN8oJoci2et1QgEJhY8u/4UVUItn+NY6wJFyBAX9k105FaPAe w6mNAeKGMW2BPk0x6XsioDDCvrR9UtnnDudLsD+MA6GIklPgkxdmCLbYRM2M 8/40s8BfzLOraetTgtmQZOx1mXK/IMA1AJI7TJcawASXJiJpG30Prv95AlpK VnZIcXyT1fIuegmRhZp8XZWhhqUFvd+gYRbWND2TorFObStNIAShs7zJRwE0 U5IArY5oACo6fdqA+pddLL8r --1563967779-129764394-1526368009=:44112-- From owner-freebsd-xen@freebsd.org Tue May 15 07:47:27 2018 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8C12AEE6348 for ; Tue, 15 May 2018 07:47:27 +0000 (UTC) (envelope-from pratiy0100@gmail.com) Received: from mail-wm0-x241.google.com (mail-wm0-x241.google.com [IPv6:2a00:1450:400c:c09::241]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 0557A7FD06 for ; Tue, 15 May 2018 07:47:27 +0000 (UTC) (envelope-from pratiy0100@gmail.com) Received: by mail-wm0-x241.google.com with SMTP id a67-v6so17540231wmf.3 for ; Tue, 15 May 2018 00:47:26 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-transfer-encoding; bh=Mp8SMkGK3h1FuwTJdqV3PHxTh4+5GyTqDZKl24Boy1g=; b=tuezu3BRHtW+Or5cSywukje7GPpOmodf3MMOFslwZbY8quMe0erWw+0gLA3TW0DbPR vsgnuTCR9Ot2jHLw3tOPQ6NXM1st2lczkePrj1wxGMzwnPitFWGX7kKpyXPgPdJgHBr0 ktXa3onkxwx1z4RItxbGp/oxPYk8VIRvT+uUaZ4+WuLSdHbtgtpQzVzhBspV7iUurwhG V84O/Qxl+/x4XgaLeu+b/yhLKgb21fnlv8tEkTAJOGKnB+IaLYtJnP16Iz4GTZCdaL2+ /aQBCdp04eU0DyC7Ly0zwA27+An+pv/Ke9ueJSnkqRfZDx5czoybnDNJqc31aj+ok7eC E1zQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=Mp8SMkGK3h1FuwTJdqV3PHxTh4+5GyTqDZKl24Boy1g=; b=DgN5fDpC8LUdyavwQisiJbIKuyKniNQleKbgYFpm4lU+pA+yYBhF8Qdxm6VQ+4++lz KZttbroi5aFpfcVkzm5G7l0K1OegK1bFd364FL41FECMCOSQ9KS9+MAhAfuGvoV73Dmk f9wtz07ax8yzo2sp4SpQv3DURbUAnwdJiH/PpIe1HR3pYaIdQyiMEBDg8mohpyv/HLFZ t6JKcOBCz2bXq7KqGf1fctfiJcopjm0pgDFv3VFzQnpfHHDr06q+ckBRJY5QwuvVFitl gxBQ4tkHMFOncucFl8jijrspkFPB8FcIHNUWiwTs6GV72jM0RsU77icA5Bkz+AV1s4h8 yS/Q== X-Gm-Message-State: ALKqPwdhQv9xsQ2536fUidlKQx8LM6XstT0PbTDkHS6mnDg0ZXT0FiUe wkQI0jA0/q2sb5HvySCiMBeshZV0Zh93XglTzQZlBQ== X-Google-Smtp-Source: AB8JxZqBwKDJ13jfKO3GDB5iaFzLd4KPIdQ2iP70d4EaYyewfz+8vKjRpl/baPxaXPC+80yDmksmkVrJ5ElYLkV/YzM= X-Received: by 2002:a50:9953:: with SMTP id l19-v6mr16678169edb.179.1526370446040; Tue, 15 May 2018 00:47:26 -0700 (PDT) MIME-Version: 1.0 Received: by 10.80.170.33 with HTTP; Tue, 15 May 2018 00:46:45 -0700 (PDT) In-Reply-To: References: <20180514170043.z3netvhmdmwnjmq3@MacBook-Pro-de-Roger.local> <20180514175505.ol4opdvdpkghx2zi@MacBook-Pro-de-Roger.local> From: Pratyush Yadav Date: Tue, 15 May 2018 13:16:45 +0530 Message-ID: Subject: Re: Is it possible to run Xen in a VirtualBox VM? To: Marcin Cieslak Cc: freebsd-xen@freebsd.org Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.26 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 15 May 2018 07:47:27 -0000 On Tue, May 15, 2018 at 12:36 PM, Marcin Cieslak wrote: > On Tue, 15 May 2018, Pratyush Yadav wrote: > >> On Mon, May 14, 2018 at 11:25 PM, Roger Pau Monn=C3=A9 wrote: >> > Yes, I think you will need to be able to run Xen + FreeBSD. You can >> > probably manage to complete the first part using Xen + Linux and >> > running FreeBSD as a guest, but you will need Xen + FreeBSD Dom0 for >> > the second part (adding handlers for mapping operations used by the >> > backend). >> >> One more thing, is there any other VM like VirtualBox that can run Xen >> + FreeBSD as Dom0, or do I have to run it on a different computer. > > I have solved this problem for me by renting a physical server at the hos= ting company. > But serious hacking requires having access to the physical console (most > hosting providers provide something like that). > > I don't know how others are working on this? Anyone running Xen on their = laptop for example? I'm trying exactly that. I am running a Linux Dom0 with a FreeBSD DomU on my current laptop. I have an old laptop lying around and I'll try to run a FreeBSD Dom0 on it. --=20 Regards, Pratyush Yadav From owner-freebsd-xen@freebsd.org Tue May 15 08:08:42 2018 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 860C6EE7851 for ; Tue, 15 May 2018 08:08:42 +0000 (UTC) (envelope-from royger@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "smtp.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 39C2884C14; Tue, 15 May 2018 08:08:42 +0000 (UTC) (envelope-from royger@FreeBSD.org) Received: from localhost (default-46-102-197-194.interdsl.co.uk [46.102.197.194]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) (Authenticated sender: royger) by smtp.freebsd.org (Postfix) with ESMTPSA id D1FF81DE78; Tue, 15 May 2018 08:08:41 +0000 (UTC) (envelope-from royger@FreeBSD.org) Date: Tue, 15 May 2018 09:08:36 +0100 From: Roger Pau =?utf-8?B?TW9ubsOp?= To: Nathan Friess Cc: Kai Otto , freebsd-xen@freebsd.org Subject: Re: Linux domU only works with xen_platform_pci=0 ? Message-ID: <20180515080836.kufr3q3mk5mxwx4q@MacBook-Pro-de-Roger.local> References: <20180513151649.4ls73myegkhm3cep@MacBook-Pro-de-Roger.local> <0749df4b-1614-dcdf-1bf2-1bbad1ae5743@duckster.net> <20180514130445.ahqk5ol3kdhriqju@MacBook-Pro-de-Roger.local> <6c0e1f5a-3e7d-054e-298c-5ec3d97e6141@gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <6c0e1f5a-3e7d-054e-298c-5ec3d97e6141@gmail.com> User-Agent: NeoMutt/20180323 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.26 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 15 May 2018 08:08:42 -0000 On Mon, May 14, 2018 at 08:34:54PM -0600, Nathan Friess wrote: > On 2018-05-14 07:04 AM, Roger Pau Monné wrote: > > On Sun, May 13, 2018 at 07:33:03PM +0200, Kai Otto wrote: > > > On 13/05/18 17:16, Roger Pau Monné wrote: > > > > On Sun, May 13, 2018 at 03:51:36PM +0200, Kai Otto wrote: > > > > > Hello, > > > > > > > > > > I'm trying to set up a FreeBSD 11.1 system as Xen virtualization host. > > > > > Following a combination of handbook [1] and wiki [2], I was able to get > > > > > get a FreeBSD dom0 in PVH mode, and FreeBSD domU in HVM mode running, > > > > > including installation to disk and networking. > > > > > > > > > > It seemed to me as if the switch 'xen_platform_pci' doesn't have an > > > > > effect on FreeBSD domU's, as I see e.g. a xenpci0 and xbd0 in dmesg no > > > > > matter if I set it to 1 or 0. > > > > > > > > > > Do I understand it correctly, that this switch makes the difference > > > > > between HVM and PVHVM mode? > > > > > According to xl.cfg(5), it 'enables a guest Operating System [...] to > > > > > make use of paravirtualization features such as disk and network devices'. > > > > > > > > > > > > > > > Afterwards, I tried to create a Linux domU. Both Centos 7 and Alpine > > > > > Linux only detected the harddisk with xen_platform_pci=0. > > > > > > > > > > For Alpine Linux, with xen_platform_pci=1, I get the following messages > > > > > on the console: > > > > > > > > > > vbd vbd-5632: 19 xenbus_dev_probe on device/vbd/5632 > > > > That's ENODEV IIRC, I think there's something wrong with FreeBSD disk > > > > backend. > > > > > > > > > vbd vbd-5632: failed to write error node for device/vbd/5632 (19 > > > > > xenbus_dev_probe on device/vbd/5632) > > > > > > > > > > After waiting for a couple minutes it boots, but doesn't detect the disk. > > I had similar issues with Linux domUs being unable to detect their disks > when FreeBSD 11.1-RELEASE is the backend: > > https://lists.freebsd.org/pipermail/freebsd-xen/2016-December/002924.html > > > What seems to be happening is that on my system the frontend and backend may > go from state InitWait to Initialised in different orders and so either end > may end up getting stuck waiting for the other side to change state when the > other side already has done so. > > I have been running with the attached patch since my last message above and > Linux domUs have been working perfectly since then. I realize that the call > to pause() is not the correct solution but it demonstrates that some fine > tuning of how the states are handled will help. Can you please give a try to the patch at: https://lists.freebsd.org/pipermail/freebsd-xen/2018-May/003132.html I think this is the proper way to solve the issue, and I would like to commit it ASAP in order to MFC it to stable-11 before 11.2 is released, but it could benefit from some more testing. Thanks, Roger. From owner-freebsd-xen@freebsd.org Tue May 15 08:14:09 2018 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id AB40CEE7E4A for ; Tue, 15 May 2018 08:14:09 +0000 (UTC) (envelope-from prvs=666baa678=roger.pau@citrix.com) Received: from SMTP.EU.CITRIX.COM (smtp.ctxuk.citrix.com [185.25.65.24]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.citrix.com", Issuer "DigiCert SHA2 Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 27EA38503A for ; Tue, 15 May 2018 08:14:08 +0000 (UTC) (envelope-from prvs=666baa678=roger.pau@citrix.com) X-IronPort-AV: E=Sophos;i="5.49,403,1520899200"; d="scan'208";a="73161506" Date: Tue, 15 May 2018 09:14:03 +0100 From: Roger Pau =?utf-8?B?TW9ubsOp?= To: Marcin Cieslak CC: Pratyush Yadav , Subject: Re: Is it possible to run Xen in a VirtualBox VM? Message-ID: <20180515081403.dcrlgur7fln56u7d@MacBook-Pro-de-Roger.local> References: <20180514170043.z3netvhmdmwnjmq3@MacBook-Pro-de-Roger.local> <20180514175505.ol4opdvdpkghx2zi@MacBook-Pro-de-Roger.local> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: User-Agent: NeoMutt/20180323 X-ClientProxiedBy: AMSPEX02CAS01.citrite.net (10.69.22.112) To AMSPEX02CL02.citrite.net (10.69.22.126) X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.26 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 15 May 2018 08:14:09 -0000 On Tue, May 15, 2018 at 07:06:49AM +0000, Marcin Cieslak wrote: > On Tue, 15 May 2018, Pratyush Yadav wrote: > > > On Mon, May 14, 2018 at 11:25 PM, Roger Pau Monné wrote: > > > Yes, I think you will need to be able to run Xen + FreeBSD. You can > > > probably manage to complete the first part using Xen + Linux and > > > running FreeBSD as a guest, but you will need Xen + FreeBSD Dom0 for > > > the second part (adding handlers for mapping operations used by the > > > backend). > > > > One more thing, is there any other VM like VirtualBox that can run Xen > > + FreeBSD as Dom0, or do I have to run it on a different computer. > > I have solved this problem for me by renting a physical server at the hosting company. > But serious hacking requires having access to the physical console (most > hosting providers provide something like that). > > I don't know how others are working on this? Anyone running Xen on their laptop for example? Xen also supports printing to a USB debug port (EHCI debug port) [0], but some laptops don't even have the USB debug port accessible, and then you need a special adapter which is impossible to find nowadays. So, the easier way to debug is to get a box with SOL or a working serial DB9 port. Roger. [0] https://www.coreboot.org/EHCI_Debug_Port From owner-freebsd-xen@freebsd.org Tue May 15 08:17:31 2018 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7597AEE8152 for ; Tue, 15 May 2018 08:17:31 +0000 (UTC) (envelope-from prvs=666baa678=roger.pau@citrix.com) Received: from SMTP.EU.CITRIX.COM (smtp.ctxuk.citrix.com [185.25.65.24]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.citrix.com", Issuer "DigiCert SHA2 Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id C94888517B for ; Tue, 15 May 2018 08:17:30 +0000 (UTC) (envelope-from prvs=666baa678=roger.pau@citrix.com) X-IronPort-AV: E=Sophos;i="5.49,403,1520899200"; d="scan'208";a="73161681" Date: Tue, 15 May 2018 09:17:26 +0100 From: Roger Pau =?utf-8?B?TW9ubsOp?= To: Pratyush Yadav CC: Subject: Re: Is it possible to run Xen in a VirtualBox VM? Message-ID: <20180515081726.5bpmb4czmnrqf553@MacBook-Pro-de-Roger.local> References: <20180514170043.z3netvhmdmwnjmq3@MacBook-Pro-de-Roger.local> <20180514175505.ol4opdvdpkghx2zi@MacBook-Pro-de-Roger.local> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: User-Agent: NeoMutt/20180323 X-ClientProxiedBy: AMSPEX02CAS02.citrite.net (10.69.22.113) To AMSPEX02CL02.citrite.net (10.69.22.126) X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.26 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 15 May 2018 08:17:31 -0000 On Tue, May 15, 2018 at 11:37:43AM +0530, Pratyush Yadav wrote: > On Mon, May 14, 2018 at 11:25 PM, Roger Pau Monné wrote: > > On Mon, May 14, 2018 at 10:49:43PM +0530, Pratyush Yadav wrote: > >> I am working on the Xen grant table handlers (for my Google Summer of > >> Code project [0]) , so do you think I would need to run Xen + FreeBSD > >> when testing? > > > > Yes, I think you will need to be able to run Xen + FreeBSD. You can > > probably manage to complete the first part using Xen + Linux and > > running FreeBSD as a guest, but you will need Xen + FreeBSD Dom0 for > > the second part (adding handlers for mapping operations used by the > > backend). > >> Also, how can I fix the error I'm currently getting about Intel > >> processor not being supported? > > > > Which error? Can you please paste the full log? > > > > Roger. > > Ah, my bad. I misread your message. I thought you were saying we can > run Xen + FreeBSD Dom0 but not a FreeBSD DomU. > > Anyway, I can't get the logs because they are not outputting to the > serial port for some reason. I wrote what I could read from the 5 > seconds I get before the reboot in my first email. You can set noreboot [0] in xen_cmdline in order to prevent Xen from rebooting automatically. That should give you more time to read the error message. > You answered my > question, but if you want a look at the error message I could read, > check my first email. I'll also paste it below [0]. > > Thanks for your help. > > -- > Regards, > Pratyush Yadav > > [0]: > xenoprof: Initialization failed. Intel processor family 6 model 60 is > not supported. > Dom0 has maximum 600 PIRQs > > *********************** > Panic on cpu 0: > Error creating domain 0 > *********************** This seems to be missing some lines. A panic usually contains a message with the reason of the panic. Roger. [0] http://xenbits.xenproject.org/docs/unstable/misc/xen-command-line.html From owner-freebsd-xen@freebsd.org Thu May 17 17:35:22 2018 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8F117EDA8E3 for ; Thu, 17 May 2018 17:35:22 +0000 (UTC) (envelope-from pratiy0100@gmail.com) Received: from mail-wm0-x22e.google.com (mail-wm0-x22e.google.com [IPv6:2a00:1450:400c:c09::22e]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 0E9136BE1C; Thu, 17 May 2018 17:35:22 +0000 (UTC) (envelope-from pratiy0100@gmail.com) Received: by mail-wm0-x22e.google.com with SMTP id l1-v6so10572933wmb.2; Thu, 17 May 2018 10:35:22 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to:cc; bh=Vj5gL0nRWE6w+tgDXLKDTMaX2M7N4sT2eWuws/yt3UQ=; b=PVMKrcZJbcERU+xUQVKDXrYqzVimiApw9hnt/ks1bM13KTaXIyNVwiw8Fi8vs+74Te 2NnlivpMX1OPvDnAQrR2WCsVpSf/mmfh/ubFNrfArXrVMGqvwVK9iqOoQj8AZ9FwhV55 Qqv6dhYu7/Q3KSRmCsfrxw1LvqMZtQqpmu+xCcrBbBg0jOf2kaIMdTp+b1ANQKjW6GBB tYYsk65deN/uLsjucLcv3UV5u7lBXlk/WSzIFoOW3gl0GwD89Q15ohDaBpEnS8mWbW8H YVXBfX04AssKY4O+XpziBXajA6dVuXgTZAdRVO85XS6gu+xZJcejcNQSbyvwB4dByrTx 9e9Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to:cc; bh=Vj5gL0nRWE6w+tgDXLKDTMaX2M7N4sT2eWuws/yt3UQ=; b=Yg+d3umbO/9Fva/5Wm0o1zmgYBNH4b2Dc1oVSgd6HmcHJVclQTrCbnBIPJ2MPmD9uu 5AB0bDx1YpH8j5622Di/mYqMSgRSBKDUv1MlOfVIEPHL435mJzAPR927vfvaND+ppW7J yDUl1b7QzXpCUFRgK8yC02n2mLf685Slbphzqnp1YjbLp01Dh6IV4N/aKIyBr/uMxrFv ixzdoIMuv/1cVqz0Tnth5UZRDIyuvG9Xth4J6md505iVOUY3PmuH80+LrTwO4q/9wpac HDZRTaaxmIHSAB7jY5J85lyzy+7gejzp65UYB4ICi9lYhfS4yCwOrZC6rntP/7l8E86m vkLg== X-Gm-Message-State: ALKqPwcpSOkvVr9DWHzZIJLThG5MwlrKQn2MYTahBqYDAucRvww3YetB AW2FnY0+QtVo8V6e5AsLAI/B67EZzZY6sHDcLj443t2w X-Google-Smtp-Source: AB8JxZoEzV4AEEcgWbrccVtzC87Xze2/lkCSvHlk45k8vMnO3jLAd91z4kyTCSN2qmTnTufjc7+alc7Gm5SZkQUyLZw= X-Received: by 2002:a50:f5cd:: with SMTP id x13-v6mr8029410edm.132.1526578520512; Thu, 17 May 2018 10:35:20 -0700 (PDT) MIME-Version: 1.0 Received: by 10.80.170.33 with HTTP; Thu, 17 May 2018 10:34:40 -0700 (PDT) From: Pratyush Yadav Date: Thu, 17 May 2018 23:04:40 +0530 Message-ID: Subject: Stuck on blank screen after booting Xen To: freebsd-xen@freebsd.org Cc: Edward Napierala , Akshay Jaggi Content-Type: text/plain; charset="UTF-8" X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.26 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 17 May 2018 17:35:22 -0000 Hi, I am trying to boot Xen on my Laptop. FreeBSD without Xen boots fine but when I install Xen and reboot, it gets to the boot loader screen, prints some Xen messages and then stops on a blank screen. I can't provide the logs as I never got the chance to look at them, they go by very fast. All I remember is seeing some dots in a line and then the blank screen. I am running it on a laptop with Intel i7 4710HQ processor. Also, my FreeBSD is installed in BIOS mode on my USB drive. Does Xen not support boot from USB? Is there any other reason its getting stuck? The config files I pretty much copied exactly from the FreeBSD as a Xen host wiki page [0]. Regards, Pratyush Yadav [0] https://www.freebsd.org/doc/handbook/virtualization-host-xen.html From owner-freebsd-xen@freebsd.org Thu May 17 17:42:09 2018 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3A0E0EDAF35 for ; Thu, 17 May 2018 17:42:09 +0000 (UTC) (envelope-from akshay1994.leo@gmail.com) Received: from mail-lf0-f48.google.com (mail-lf0-f48.google.com [209.85.215.48]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 92FB16C509; Thu, 17 May 2018 17:42:08 +0000 (UTC) (envelope-from akshay1994.leo@gmail.com) Received: by mail-lf0-f48.google.com with SMTP id i11-v6so4728043lfb.7; Thu, 17 May 2018 10:42:08 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=TBxEeRN8oIs0y2PCx0cmTBRg/E0aWb3MRZLnYaLt6ic=; b=QuwNanZYq5H1HPM2EApyW4bDAv5wcOx9n1IZjuT6yzB12yNbZyaVVrtTYr/9htyx5q kH1L0ASRAXm+Yn0zPX8uUOZ+OBE0yTjVieWlrHzUVsAcYbWBL+LpjJN5uEVtJZLIOPvU z9++ei0RQG31pEf7HZYuf5txPThIUwUi8WucBE+St3alNzqcA2PJf9bJAdXFBrzW82js 6YzxP5UFaTybh2+5/dWOb22Rm1rQJSuFm0fcJruzfmhuaTghuHa5flcgXdCsBUbLlneh AIOGXju0eqG2fkmTfupoR/lGZWd4yHlYIltthd2w6DID0niD63JP8xnOUKYeMticVMHX lDnQ== X-Gm-Message-State: ALKqPweK4uzO9zlxokffPlFTLT3ZIArldlLY6t4GypDKqjeidPCI3sM/ QlanF2pFOQtbk0r76LPqv9uAu5T+ X-Google-Smtp-Source: AB8JxZrqBfmq3Wu9KOGVjsQwG7JXbZwZHs5PV1xGRb9/0ls06Kk4euQgVzUCD0yg8Zr/YK/d5eVWfQ== X-Received: by 2002:a19:4310:: with SMTP id q16-v6mr3145498lfa.74.1526578921195; Thu, 17 May 2018 10:42:01 -0700 (PDT) Received: from mail-lf0-f42.google.com (mail-lf0-f42.google.com. [209.85.215.42]) by smtp.gmail.com with ESMTPSA id o18-v6sm1349070lfg.16.2018.05.17.10.42.00 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 17 May 2018 10:42:00 -0700 (PDT) Received: by mail-lf0-f42.google.com with SMTP id t129-v6so9998148lff.3; Thu, 17 May 2018 10:42:00 -0700 (PDT) X-Received: by 2002:a19:c48f:: with SMTP id u137-v6mr17888854lff.2.1526578920595; Thu, 17 May 2018 10:42:00 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Akshay Jaggi Date: Thu, 17 May 2018 18:41:50 +0100 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: Stuck on blank screen after booting Xen To: Pratyush Yadav Cc: FreeBSD-Xen , Edward Napierala Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.26 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.26 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 17 May 2018 17:42:09 -0000 I guess this is expected behaviour. My knowledge is two years old. But iirc, Dom0/Xen sent output over serial. On Thu 17 May, 2018, 6:35 PM Pratyush Yadav, wrote: > Hi, > > I am trying to boot Xen on my Laptop. FreeBSD without Xen boots fine > but when I install Xen and reboot, it gets to the boot loader screen, > prints some Xen messages and then stops on a blank screen. > > I can't provide the logs as I never got the chance to look at them, > they go by very fast. All I remember is seeing some dots in a line and > then the blank screen. > > I am running it on a laptop with Intel i7 4710HQ processor. Also, my > FreeBSD is installed in BIOS mode on my USB drive. Does Xen not > support boot from USB? Is there any other reason its getting stuck? > The config files I pretty much copied exactly from the FreeBSD as a > Xen host wiki page [0]. > > Regards, > Pratyush Yadav > > [0] https://www.freebsd.org/doc/handbook/virtualization-host-xen.html > From owner-freebsd-xen@freebsd.org Fri May 18 00:10:19 2018 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 76B66EE400A for ; Fri, 18 May 2018 00:10:19 +0000 (UTC) (envelope-from nathan.friess@gmail.com) Received: from mail-pl0-x244.google.com (mail-pl0-x244.google.com [IPv6:2607:f8b0:400e:c01::244]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id DB5CE7C4F0; Fri, 18 May 2018 00:10:18 +0000 (UTC) (envelope-from nathan.friess@gmail.com) Received: by mail-pl0-x244.google.com with SMTP id v24-v6so3494066plo.3; Thu, 17 May 2018 17:10:18 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=subject:to:cc:references:from:message-id:date:user-agent :mime-version:in-reply-to:content-language:content-transfer-encoding; bh=Zl3ZYXvCLILo9jg6bhq4TBcSr1uMttZS7dr0EKPYleM=; b=ZpN2DVUAExl0QBVAEPdn1KLXVYUBFHtH+Cu62LR4kNjvqgvwx4xrFUnGAZhdwThXp2 VxnShrFr3BblAjgUTqQXpjnz9vKgqMPVTOn0dvgTmsvaUp48c6xaaRdjdgcYKGxHUOkF uZMi8woZVVUfutgDZk6Q96mZi2NehuNkRrOMvSVu9H8tgRsAdQ/5LBVaumAAVPBLKLso FVkt1Ybu/kXgHNILcsvWkO29MqiPjYrje6SsjX90PgLFSnSZa3JaQOxSvQhMBErDvgBg ouk03ZSVh420jUJ/itWt1O2w9gNZz/fxR6oq/5boAt5nempEEAe6eDfC/2GCdH5llSJh 2z9A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:cc:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=Zl3ZYXvCLILo9jg6bhq4TBcSr1uMttZS7dr0EKPYleM=; b=PL54+FMxkRg6WFhIlgsfIPb11NGkmXMakLz/FEH4zDmrujFsYbW4cxFyAfoCyJcAvK qE0P2wHebo43hZCpV3O5Os8VRVCwxpEXQnrqmZMS9Acpjc4NbmeeWszIkyyv7XWrDsrH zLRMhnHVBpFyGErwiuiVtp0STVhiSe+BDsRfR9yiaOuKhkQV5DfDRYkxCWg3lFXuZ2LI VoWRbIVjTwX+bmPm15SJu7Lh9K7xExp4VL6VXvRp1DCcbRdIyKlZ9t2ipwx1P9RpGvj8 4/XOaJYlSxz+XK94PKoABFGZa8rBjPfpmma9K3RRM2MB3B+J3vNZ6AGJM/of4WZ3KE2b cRhQ== X-Gm-Message-State: ALKqPwdcsz8iKdYMUJdcgpPAiId9x1VSJN5O1TYzL1PlIL6ZWbv6rqNq PDkJ1CkVJlUEjsf3wqbShmu/9IWp X-Google-Smtp-Source: AB8JxZogIONfYwpR6WolJOVgjq3Rmwht6gCwdPkSYO+EzOPr5A8x2Kah9udqU9txoV5OQ3nPm6kjMQ== X-Received: by 2002:a17:902:8541:: with SMTP id d1-v6mr7479916plo.106.1526602217431; Thu, 17 May 2018 17:10:17 -0700 (PDT) Received: from [10.2.1.1] (S01060018e7c4b870.cg.shawcable.net. [70.72.182.108]) by smtp.gmail.com with ESMTPSA id t9-v6sm9163329pgr.37.2018.05.17.17.10.16 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 17 May 2018 17:10:17 -0700 (PDT) Subject: Re: Linux domU only works with xen_platform_pci=0 ? To: =?UTF-8?Q?Roger_Pau_Monn=c3=a9?= Cc: freebsd-xen@freebsd.org References: <20180513151649.4ls73myegkhm3cep@MacBook-Pro-de-Roger.local> <0749df4b-1614-dcdf-1bf2-1bbad1ae5743@duckster.net> <20180514130445.ahqk5ol3kdhriqju@MacBook-Pro-de-Roger.local> <6c0e1f5a-3e7d-054e-298c-5ec3d97e6141@gmail.com> <20180515080836.kufr3q3mk5mxwx4q@MacBook-Pro-de-Roger.local> From: Nathan Friess Message-ID: Date: Thu, 17 May 2018 18:10:15 -0600 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.6.0 MIME-Version: 1.0 In-Reply-To: <20180515080836.kufr3q3mk5mxwx4q@MacBook-Pro-de-Roger.local> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.26 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 18 May 2018 00:10:19 -0000 On 2018-05-15 02:08 AM, Roger Pau Monné wrote: > On Mon, May 14, 2018 at 08:34:54PM -0600, Nathan Friess wrote: >> >> I had similar issues with Linux domUs being unable to detect their disks >> when FreeBSD 11.1-RELEASE is the backend: >> >> https://lists.freebsd.org/pipermail/freebsd-xen/2016-December/002924.html >> >> >> What seems to be happening is that on my system the frontend and backend may >> go from state InitWait to Initialised in different orders and so either end >> may end up getting stuck waiting for the other side to change state when the >> other side already has done so. >> >> I have been running with the attached patch since my last message above and >> Linux domUs have been working perfectly since then. I realize that the call >> to pause() is not the correct solution but it demonstrates that some fine >> tuning of how the states are handled will help. > > Can you please give a try to the patch at: > > https://lists.freebsd.org/pipermail/freebsd-xen/2018-May/003132.html > > I think this is the proper way to solve the issue, and I would like to > commit it ASAP in order to MFC it to stable-11 before 11.2 is > released, but it could benefit from some more testing. > > Thanks, Roger. > I tried the patch on and I my Linux domU did was not able to complete the attachment to the FreeBSD backend. I applied the patch to the 11-RELEASE kernel. (I couldn't get 11-STABLE to compile.) With xen_platform_pci=0 the frontend and backend vbds were both stuck in state 1. With xen_platform_pci=1 the frontend was in state 1 and backend in state 3. This second case is one that I think was happening before and why I added the pause as a hack. Things seems to work best if both ends see each other go into state 2 and then proceed from there. Adding the pause back in allows the frontend to go into state 3 but for some reason the backend stays in state 2. So the above patch is an improvement but it is still possible to miss state changes. I didn't have time last night to do full debugging to see why the backend didn't move from state 2 to 3 in the last case. Nathan From owner-freebsd-xen@freebsd.org Fri May 18 10:13:43 2018 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BAD07EF069C for ; Fri, 18 May 2018 10:13:43 +0000 (UTC) (envelope-from pratiy0100@gmail.com) Received: from mail-wm0-x230.google.com (mail-wm0-x230.google.com [IPv6:2a00:1450:400c:c09::230]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 2CC586FC5D; Fri, 18 May 2018 10:13:43 +0000 (UTC) (envelope-from pratiy0100@gmail.com) Received: by mail-wm0-x230.google.com with SMTP id o78-v6so14213288wmg.0; Fri, 18 May 2018 03:13:43 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=8lB/KocKfeG2Kqq0sKHkyduaLOWxG1SNMq2KX9f0FZ0=; b=e3yKBxRdnRfsn+T+4WLI4NPeFnYuJ5z20XOjvqE5p3usEcWLBVAPAmx+HlLgVybIGc ZaRxDdT6ndMf+uvda2VzRiI/FoSGj/SFBLbagEXvlDoUe4hJlKQbVc3ZtFtdBoWJiTxW 15/RxpKTzUX2JtoPrtieWhb6f7zHb4vo5C1PHwJzKO34LdFOcirZT66SR9bOd+x4YFHl xyKiW6zUFPE81L5ERbAnqDJIXbmFZ923bO+dNf/2uNCJmKN+9LRoVkmkMEDM4FSlS/Am snGMabCfCGIRnLdTBcdUqiK7bGM4xew0AmIjl8gngSgL+FoLHadeIpZxdsBGXTf1+eQx 4/Pw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=8lB/KocKfeG2Kqq0sKHkyduaLOWxG1SNMq2KX9f0FZ0=; b=QTejqzGuoIUKifIGebl9n9j2VFeZ0V8FHyUgM8LxHtw0mKJ41Y4DKOg7R07Rqi8KT5 N9S2vNnHifqldhcHLWGNgRjV3Ny5gMp+jTld3G9qwBd9qRDq9LbR/um7yo9E73DJAHj4 8QqMGeYMbaTcEYp4vhyKoCIzbo5gJJFQv8pSAtmUlPUUYVrS5jom4lKdt1w8/yjPd+05 fZ6zZvN1N/WlDkrI6HcZSgZp4njN698JmDoeJrMlAW6pIsTZHm26kWAPjwjEDWS6iDd7 3/0iU9VNxtDS85EOWGYvThEBo/r8fDzk+PV1GJzhoqAALr6dYXZT0CB9wiKtZsTyMsNL 11Mw== X-Gm-Message-State: ALKqPwfyRbmGnl9AEuTrz7KHRECXMJpuzL39Ub+qgFkvyPeQawGHXjje QWu7PkBW+pSNJsN2XYvWuaEoZsgbj+zamJ1pBC6LaqcB X-Google-Smtp-Source: AB8JxZqmIcxTIIwlFTkRLYrr6+S0HCoLdlEZp/6iyB+3p1vHhi2hXl62J4gbTrs4i1/5ovSRs7jMi6GNHcKtV5TZ9/E= X-Received: by 2002:a50:ad69:: with SMTP id z38-v6mr11355750edc.306.1526638421973; Fri, 18 May 2018 03:13:41 -0700 (PDT) MIME-Version: 1.0 Received: by 10.80.170.33 with HTTP; Fri, 18 May 2018 03:13:01 -0700 (PDT) In-Reply-To: References: From: Pratyush Yadav Date: Fri, 18 May 2018 15:43:01 +0530 Message-ID: Subject: Re: Stuck on blank screen after booting Xen To: Akshay Jaggi Cc: FreeBSD-Xen , Edward Napierala Content-Type: text/plain; charset="UTF-8" X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.26 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 18 May 2018 10:13:44 -0000 HI, On Thu, May 17, 2018 at 11:11 PM, Akshay Jaggi wrote: > I guess this is expected behaviour. My knowledge is two years old. But iirc, > Dom0/Xen sent output over serial. Thanks! This put me on the right track. I enabled the vga output by adding the option vga=current,keep in the Xen command line. The optional keep parameter causes Xen to continue using the vga console even after dom0 has been started. The default behaviour is to relinquish control to dom0. Xen still does not boot for me, but I'll ask that in a different thread. > On Thu 17 May, 2018, 6:35 PM Pratyush Yadav, wrote: >> >> Hi, >> >> I am trying to boot Xen on my Laptop. FreeBSD without Xen boots fine >> but when I install Xen and reboot, it gets to the boot loader screen, >> prints some Xen messages and then stops on a blank screen. >> >> I can't provide the logs as I never got the chance to look at them, >> they go by very fast. All I remember is seeing some dots in a line and >> then the blank screen. >> >> I am running it on a laptop with Intel i7 4710HQ processor. Also, my >> FreeBSD is installed in BIOS mode on my USB drive. Does Xen not >> support boot from USB? Is there any other reason its getting stuck? >> The config files I pretty much copied exactly from the FreeBSD as a >> Xen host wiki page [0]. >> >> Regards, >> Pratyush Yadav >> >> [0] https://www.freebsd.org/doc/handbook/virtualization-host-xen.html -- Regards, Pratyush Yadav From owner-freebsd-xen@freebsd.org Fri May 18 11:59:48 2018 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C4E69EF2C2C for ; Fri, 18 May 2018 11:59:48 +0000 (UTC) (envelope-from pratiy0100@gmail.com) Received: from mail-wm0-x229.google.com (mail-wm0-x229.google.com [IPv6:2a00:1450:400c:c09::229]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 3F6EE72C07; Fri, 18 May 2018 11:59:48 +0000 (UTC) (envelope-from pratiy0100@gmail.com) Received: by mail-wm0-x229.google.com with SMTP id o78-v6so14769801wmg.0; Fri, 18 May 2018 04:59:48 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to:cc; bh=Fld5mHDZmwTn/Wop6Ghrd89YUSyXooPt9vHJtHlAiC8=; b=AJtQU6oFyiX4XoTMsLymqzybiPC5IPR7SIhTCmBWIuBRuLw/gdlSi8wLJpawDD+1M+ vD5LBgUlXMvzcD+gt4iGQ4S7IdE2o6iUzZdtHTRWaiKalz0Ape4i7IhOGQMPppsjDdPD NTCIiBOkC67DugzConurIXxM3pQgOp5U5YdNqXD9Wcg2DZ3QV4Tfmq8FCgy72Zv1xXTC aX9HPJzXahKvDoGVMTrfc95Mp1v4VPSc46N91ojm+FDvrkZ2KUjlkOFc0RoOGqXtW2Xy /8cFzGYZBDZHe+xSFJKiS+uFuyuILBtd+sSLMOKEafNimcIPv2ilcLDNI+3Yeyrh3NNK BJFw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to:cc; bh=Fld5mHDZmwTn/Wop6Ghrd89YUSyXooPt9vHJtHlAiC8=; b=OrZftPx2E4IHWYnYqPzAHTRbHZJNVws6XzHoZAxXMYSdGIgqrMeKSyNVGWa8ckNVcG pnUHMo2GEBr/9UCqF01OjU6Oj4A92BH7JxOMllS6Jwh8ONZkB+4g8voJYiq7I4yVHZay C9UWqJWxxIYZfCjAkKuo3EV8ei1MxaNhQKKDtNQ0nf0ECmEdfGmVNFO2dxwFkx4a89Em rituZ3NZQTDYNXQ4VSiz1mFW7u94i01Jwo9DDvuSmmHSeiFH2YW36NV+e5xJGfSnov4L LvCQwS7AUlukJwwfrZ/YKkkwE5zyo52LakdXOI6YeSiKj79q+kz4y+suDsq3iuOCXC38 8gtg== X-Gm-Message-State: ALKqPwfR8Z1u+4fCfjxaWUbujw8IcT7mfV7tdvjh39HgCWBqo1ut4FyV JJelULWoSGrPliv/keQyl6EzqZuH1uGFmfo4EDW7Kg== X-Google-Smtp-Source: AB8JxZovT9FBOnSssIbYYVqgvM466oAOxVldTj8YWWPGgQDUhQyyKWAY0h4YFO7YY5xrLQirl107uHDgTefVWBXMPis= X-Received: by 2002:a50:f5cd:: with SMTP id x13-v6mr11356163edm.132.1526644786784; Fri, 18 May 2018 04:59:46 -0700 (PDT) MIME-Version: 1.0 Received: by 10.80.170.33 with HTTP; Fri, 18 May 2018 04:59:06 -0700 (PDT) From: Pratyush Yadav Date: Fri, 18 May 2018 17:29:06 +0530 Message-ID: Subject: Xen kernel fails to boot, d0v1 triple fault looks like the cuplrit To: FreeBSD-Xen Cc: Edward Napierala , Akshay Jaggi Content-Type: text/plain; charset="UTF-8" X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.26 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 18 May 2018 11:59:49 -0000 Hi, So I have been trying to get Xen to boot on my laptop. It is getting stuck with the following error messages: (XEN) Scrubbing free RAM on 1 nodes using 4 CPUs (XEN) [VT-D] DMAR: [DMA Read} Request device [0000:00:1a.0] fault addr 9ce13000. iommu reg - ffff82c000203000 (XEN) [VT-D] DMAR: reason 06 - PTE read access is not set (XEN) ........... done (XEN) initial low memory virq threshold set at 0x200 pages. (XEN) Std. Loglevel: All (XEN) Guest Loglevel: All (XEN) Xen is keeping VGA console (XEN) Boot video device 00:02.0 (XEN) ***Serial input -> DOM0 (type 'CTRL-a' three times to switch input to Xen) (XEN) Freed 320 kB init memory FreeBSD PVH running on xen-3.0-x86_64p Copyright (c) 1992-2018 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 12.0-CURRENT #0 r333606: Mon May 14 19:59:08 UTC 2018 root@releng3.nyi.freebsd.org:/usr/obj/usr/src/amd64.amd64/sys/GENERIC amd64 WARNING: WITNESS option enabled, expect reduced performance. VT(vga): text 80x25 CPU: Intel(R) Core(TM) i7-4710HQ CPU @ 2.50GHz (2494.22-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306c3 Family=0x6 Model=0x3c Stepping=3 Features=0x17c1cbf5 Features2=0xf6f83203 AMD Features=0x20101800NX,LM> AMD Features2=0x21< Structured Extended Features=0x2329 Hypervisor: Origin = "XenVMMXenVMM" real memory = 9991770112 (9528 MB) avail memory = 7936724992 (7569 MB) (XEN) d0v1 Triple fault - invoking HVM shutdown action 0 (XEN) *** Dumping Dom0 vcpu#1 state: *** (XEN) ----[ Xen-4.7.2 x86_64 debug=n Not tainted ]---- (XEN) CPU: 1 (XEN) RIP: 0020:[] (XEN) RFLAGS: 0000000000010016 CONTEXT: hvm guest (d0v1) (XEN) rax: 0000000000000000 rbx: ffffffff8201c100 rcx: 0000000000000001 (XEN) rdx: 0000000000003078 rsi: ffffffff81b992f8 rdi: fffffe0003bb6078 (XEN) rbp: fffffe00009ffff0 rsp: fffffe00009fffa0 r8: 00000000ffffffff (XEN) r15: 0000000000000400 cr0: 0000000000000011 cr4: 0000000000000020 (XEN) cr3: 00000000035a4000 cr2: 0000000000000ff0 (XEN) ds: 0028 es: 0028 fs: 0028 gs: 0028 ss: 0028 cs: 0020 (XEN) Guest stack trace from rsp=fffffe00009fffa0: (XEN) Fault while accessing guest memory. (XEN) Hardware Dom0 halted: halting machine Any idea why this is happening and how can I fix this? Thanks, Pratyush Yadav From owner-freebsd-xen@freebsd.org Fri May 18 13:13:46 2018 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 52204EF4C06 for ; Fri, 18 May 2018 13:13:46 +0000 (UTC) (envelope-from etnapierala@gmail.com) Received: from mail-lf0-x243.google.com (mail-lf0-x243.google.com [IPv6:2a00:1450:4010:c07::243]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id A4CF77531A; Fri, 18 May 2018 13:13:45 +0000 (UTC) (envelope-from etnapierala@gmail.com) Received: by mail-lf0-x243.google.com with SMTP id w202-v6so13856193lff.12; Fri, 18 May 2018 06:13:45 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=sender:mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=4bm5JFRn4bP5YT8Stdty++5C14C5Wo4+q5L6k4f09Ow=; b=KMsfvo4mtTB9TOY8JoHurgwVMMNIxM8Ku6HKgi//eVhXH5s2QvjZMLNNgQmIVFXPeD HlFk50B4AK+DxcHo0do0RXKNh5mfvuFdGBQibM3ymoKonLfM2RjpkOt/cVVld+VLYc/6 fjY8h5ByARw/kaKMfL6BJi5k7Dd46Br74f3d6xeslgYRBj9aePfbzj0fT8WRw6b9szhI Bh9hRkICNlq+4leMpuy+J3EGUcCet9oL/aKELHyRgN5B7wx8XSnoEkBowpeB0bUVxqdY U28BPVXZe9jHBh8wwoI8Cf2pC2fvKRgrsddbznG5vNyVTQ84Nm9q2HMwLjb7pMnV1mQx 1ugA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:mime-version:subject:from:in-reply-to :date:cc:content-transfer-encoding:message-id:references:to; bh=4bm5JFRn4bP5YT8Stdty++5C14C5Wo4+q5L6k4f09Ow=; b=XyHfR64FxKKGnDzVOXbYX2PtEwoJAknSB3sbrXGaTh59Tk9NDRsh+qkUkefLqEU32m 9pnVWUBFEHWhaiZt3A/zxbVwx8CWe0E18pSDhbX1ipolq4W4g8rDZZXpEMXof/A9B8Z8 cMdBZ51mXw56AToPXcIUUel2ciXr7OmEVg+GyivKPTClkhCfhNMQOOrtAcpPQgvEh0b8 lxuYgHlp7Ifn+nWlgsx4Ak46K1xjSSXpLztgArsUhUrk1wNRcpbWMgww3OtNouyC4FpY RjpjCUKf7hwjLFQgCEYod56a34QVX8p/OlMAgNsMzcOhOFnu5zmN9KXJzOyTxJ9lVrcy a+xw== X-Gm-Message-State: ALKqPwcVWmWJODMzsW+71gMbKOIf4/fhcFjQqlOmTynzFBYGC1BSq9an KqHvWLZYnRGyZuICljIJdlMwKVad X-Google-Smtp-Source: AB8JxZpWJlpQ9uj3Mo5gAf6Tyvkm/1yq0P4a3y2siDf4lWGZb2888H44uzVnmbn3xlnbWE1rC91qxA== X-Received: by 2002:a19:1760:: with SMTP id n93-v6mr18565486lfi.113.1526649224029; Fri, 18 May 2018 06:13:44 -0700 (PDT) Received: from [10.112.76.68] (apn-31-0-47-101.dynamic.gprs.plus.pl. [31.0.47.101]) by smtp.gmail.com with ESMTPSA id l24-v6sm1266738ljg.19.2018.05.18.06.13.43 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Fri, 18 May 2018 06:13:43 -0700 (PDT) Sender: =?UTF-8?Q?Edward_Tomasz_Napiera=C5=82a?= Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (1.0) Subject: Re: Xen kernel fails to boot, d0v1 triple fault looks like the cuplrit From: =?utf-8?Q?Edward_Tomasz_Napiera=C5=82a?= X-Mailer: iPhone Mail (15E302) In-Reply-To: Date: Fri, 18 May 2018 14:13:40 +0100 Cc: FreeBSD-Xen , Akshay Jaggi Content-Transfer-Encoding: quoted-printable Message-Id: <8B64FF6E-78C5-4803-ACE0-D569EA5FDAB2@FreeBSD.org> References: To: Pratyush Yadav X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.26 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 18 May 2018 13:13:46 -0000 > On 18 May 2018, at 12:59, Pratyush Yadav wrote: >=20 > Hi, >=20 > So I have been trying to get Xen to boot on my laptop. It is getting > stuck with the following error messages: >=20 > (XEN) Scrubbing free RAM on 1 nodes using 4 CPUs > (XEN) [VT-D] DMAR: [DMA Read} Request device [0000:00:1a.0] fault addr > 9ce13000. iommu reg - ffff82c000203000 > (XEN) [VT-D] DMAR: reason 06 - PTE read access is not set > (XEN) ........... done > (XEN) initial low memory virq threshold set at 0x200 pages. > (XEN) Std. Loglevel: All > (XEN) Guest Loglevel: All > (XEN) Xen is keeping VGA console > (XEN) Boot video device 00:02.0 > (XEN) ***Serial input -> DOM0 (type 'CTRL-a' three times to switch input t= o Xen) > (XEN) Freed 320 kB init memory > FreeBSD PVH running on xen-3.0-x86_64p > Copyright (c) 1992-2018 The FreeBSD Project. > Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, > 1994 The regents of the University of California. All rights reserved. > FreeBSD is a registered trademark of The FreeBSD Foundation. > FreeBSD 12.0-CURRENT #0 r333606: Mon May 14 19:59:08 UTC 2018 > root@releng3.nyi.freebsd.org:/usr/obj/usr/src/amd64.amd64/sys/GENERIC a= md64 > WARNING: WITNESS option enabled, expect reduced performance. > VT(vga): text 80x25 > CPU: Intel(R) Core(TM) i7-4710HQ CPU @ 2.50GHz (2494.22-MHz K8-class CPU) > Origin=3D"GenuineIntel" Id=3D0x306c3 Family=3D0x6 Model=3D0x3c Stepping= =3D3 > Features=3D0x17c1cbf5 FXSR,SSE,SSE2,HTT> > Features2=3D0xf6f83203 POPCNT,AESNI,XSAVE,AVX,F16C,RDRAND,HV> > AMD Features=3D0x20101800NX,LM> > AMD Features2=3D0x21< > Structured Extended Features=3D0x2329 > Hypervisor: Origin =3D "XenVMMXenVMM" > real memory =3D 9991770112 (9528 MB) > avail memory =3D 7936724992 (7569 MB) > (XEN) d0v1 Triple fault - invoking HVM shutdown action 0 > (XEN) *** Dumping Dom0 vcpu#1 state: *** > (XEN) ----[ Xen-4.7.2 x86_64 debug=3Dn Not tainted ]---- > (XEN) CPU: 1 > (XEN) RIP: 0020:[] > (XEN) RFLAGS: 0000000000010016 CONTEXT: hvm guest (d0v1) > (XEN) rax: 0000000000000000 rbx: ffffffff8201c100 rcx: 000000000000000= 1 > (XEN) rdx: 0000000000003078 rsi: ffffffff81b992f8 rdi: fffffe0003bb607= 8 > (XEN) rbp: fffffe00009ffff0 rsp: fffffe00009fffa0 r8: 00000000ffffffff= > (XEN) r15: 0000000000000400 cr0: 0000000000000011 cr4: 000000000000002= 0 > (XEN) cr3: 00000000035a4000 cr2: 0000000000000ff0 > (XEN) ds: 0028 es: 0028 fs: 0028 gs: 0028 ss: 0028 cs: 0020 > (XEN) Guest stack trace from rsp=3Dfffffe00009fffa0: > (XEN) Fault while accessing guest memory. > (XEN) Hardware Dom0 halted: halting machine >=20 > Any idea why this is happening and how can I fix this? First thing I=E2=80=99d try is to checkout an earlier version - eg from thre= e months ago) and see if it persist. Another thing to do (in parallel) is t= o file a PR (http://bugs.freebsd.org). From owner-freebsd-xen@freebsd.org Fri May 18 13:25:48 2018 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E87BCEA8022 for ; Fri, 18 May 2018 13:25:47 +0000 (UTC) (envelope-from akshay1994.leo@gmail.com) Received: from mail-lf0-f43.google.com (mail-lf0-f43.google.com [209.85.215.43]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 48C7375A79; Fri, 18 May 2018 13:25:47 +0000 (UTC) (envelope-from akshay1994.leo@gmail.com) Received: by mail-lf0-f43.google.com with SMTP id t129-v6so13963352lff.3; Fri, 18 May 2018 06:25:47 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=/k9Xaah6z74hjBscB1PI62YLjSsnsJilx3YwETcdv3U=; b=GdH3htVFSGZg1RCNqblZtlhWbN50Kn+wmqBKHVIvWvMM6Ozz5ZFekVgWGMG27M5E8d S9QmE9K9Bj5q1EuhnnIn3TgHy2edPF+x6kyuB+HnDlmY6RdbHSJ4Y3ZO/q+eFtKID7Y1 NyeJ+bhcJND1QTlFR313QoOfnVmEvn5tNT73nxuxYZXnDUs0o51fUJBlG/6pcjJlM8s7 XWNm3IeNH6hSpKp0goODrEom4VCZ/Llv1fZlFwcbQB8owrBNyyGECo6TwY3H6gCRBJ+4 zh80MQWyZKYaILMpr8qRom7FRUA99hcqUvCiHMvVDhjDvMOhYigFAqMYrEfDX/ZUNero Yjgg== X-Gm-Message-State: ALKqPwfhLZ416OtRHDH3O0ypIcIxYvfz2fdJ3eA4WXkc3nEjrTIAKbFo U/oKeRA7Kpu4DIYj1PDgtvFI+OxM X-Google-Smtp-Source: AB8JxZqC+GEPc7UkveKTMRYGv8gXGDtYld2TWLJ15t1RBZz71DCVHZuGX3A9Qs6+WXYh4jBOn7cbVA== X-Received: by 2002:a2e:92ca:: with SMTP id k10-v6mr5674272ljh.1.1526649939912; Fri, 18 May 2018 06:25:39 -0700 (PDT) Received: from mail-lf0-f48.google.com (mail-lf0-f48.google.com. [209.85.215.48]) by smtp.gmail.com with ESMTPSA id q68-v6sm1858971lfq.58.2018.05.18.06.25.39 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Fri, 18 May 2018 06:25:39 -0700 (PDT) Received: by mail-lf0-f48.google.com with SMTP id h197-v6so13927399lfg.11; Fri, 18 May 2018 06:25:39 -0700 (PDT) X-Received: by 2002:a2e:c41:: with SMTP id o1-v6mr5759004ljd.87.1526649939475; Fri, 18 May 2018 06:25:39 -0700 (PDT) MIME-Version: 1.0 References: <8B64FF6E-78C5-4803-ACE0-D569EA5FDAB2@FreeBSD.org> In-Reply-To: <8B64FF6E-78C5-4803-ACE0-D569EA5FDAB2@FreeBSD.org> From: Akshay Jaggi Date: Fri, 18 May 2018 14:25:29 +0100 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: Xen kernel fails to boot, d0v1 triple fault looks like the cuplrit To: Edward Napierala Cc: Pratyush Yadav , FreeBSD-Xen Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.26 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.26 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 18 May 2018 13:25:48 -0000 Looks to me like a configuration error. Worst case, incompatible hardware. Iirc, you mentioned Xen and Freebsd were on a USB drive. Can you try using a hard drive partition? Also, there was an option to enable verbose logging. Regards, Akshay On Fri 18 May, 2018, 2:13 PM Edward Tomasz Napiera=C5=82a, wrote: > > > On 18 May 2018, at 12:59, Pratyush Yadav wrote: > > > > Hi, > > > > So I have been trying to get Xen to boot on my laptop. It is getting > > stuck with the following error messages: > > > > (XEN) Scrubbing free RAM on 1 nodes using 4 CPUs > > (XEN) [VT-D] DMAR: [DMA Read} Request device [0000:00:1a.0] fault addr > > 9ce13000. iommu reg - ffff82c000203000 > > (XEN) [VT-D] DMAR: reason 06 - PTE read access is not set > > (XEN) ........... done > > (XEN) initial low memory virq threshold set at 0x200 pages. > > (XEN) Std. Loglevel: All > > (XEN) Guest Loglevel: All > > (XEN) Xen is keeping VGA console > > (XEN) Boot video device 00:02.0 > > (XEN) ***Serial input -> DOM0 (type 'CTRL-a' three times to switch inpu= t > to Xen) > > (XEN) Freed 320 kB init memory > > FreeBSD PVH running on xen-3.0-x86_64p > > Copyright (c) 1992-2018 The FreeBSD Project. > > Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, > > 1994 The regents of the University of California. All rights reserved. > > FreeBSD is a registered trademark of The FreeBSD Foundation. > > FreeBSD 12.0-CURRENT #0 r333606: Mon May 14 19:59:08 UTC 2018 > > root@releng3.nyi.freebsd.org:/usr/obj/usr/src/amd64.amd64/sys/GENERI= C > amd64 > > WARNING: WITNESS option enabled, expect reduced performance. > > VT(vga): text 80x25 > > CPU: Intel(R) Core(TM) i7-4710HQ CPU @ 2.50GHz (2494.22-MHz K8-class CP= U) > > Origin=3D"GenuineIntel" Id=3D0x306c3 Family=3D0x6 Model=3D0x3c Stepp= ing=3D3 > > > Features=3D0x17c1cbf5 > FXSR,SSE,SSE2,HTT> > > > Features2=3D0xf6f83203 > POPCNT,AESNI,XSAVE,AVX,F16C,RDRAND,HV> > > AMD Features=3D0x20101800NX,LM> > > AMD Features2=3D0x21< > > Structured Extended > Features=3D0x2329 > > Hypervisor: Origin =3D "XenVMMXenVMM" > > real memory =3D 9991770112 (9528 MB) > > avail memory =3D 7936724992 (7569 MB) > > (XEN) d0v1 Triple fault - invoking HVM shutdown action 0 > > (XEN) *** Dumping Dom0 vcpu#1 state: *** > > (XEN) ----[ Xen-4.7.2 x86_64 debug=3Dn Not tainted ]---- > > (XEN) CPU: 1 > > (XEN) RIP: 0020:[] > > (XEN) RFLAGS: 0000000000010016 CONTEXT: hvm guest (d0v1) > > (XEN) rax: 0000000000000000 rbx: ffffffff8201c100 rcx: > 0000000000000001 > > (XEN) rdx: 0000000000003078 rsi: ffffffff81b992f8 rdi: > fffffe0003bb6078 > > (XEN) rbp: fffffe00009ffff0 rsp: fffffe00009fffa0 r8: > 00000000ffffffff > > (XEN) r15: 0000000000000400 cr0: 0000000000000011 cr4: > 0000000000000020 > > (XEN) cr3: 00000000035a4000 cr2: 0000000000000ff0 > > (XEN) ds: 0028 es: 0028 fs: 0028 gs: 0028 ss: 0028 cs: 0020 > > (XEN) Guest stack trace from rsp=3Dfffffe00009fffa0: > > (XEN) Fault while accessing guest memory. > > (XEN) Hardware Dom0 halted: halting machine > > > > Any idea why this is happening and how can I fix this? > > First thing I=E2=80=99d try is to checkout an earlier version - eg from t= hree > months ago) and see if it persist. Another thing to do (in parallel) is = to > file a PR (http://bugs.freebsd.org). > > From owner-freebsd-xen@freebsd.org Sat May 19 08:02:59 2018 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 283FEEF2E47 for ; Sat, 19 May 2018 08:02:59 +0000 (UTC) (envelope-from royger@FreeBSD.org) Received: from smtp.freebsd.org (unknown [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "smtp.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id C35A08509E; Sat, 19 May 2018 08:02:58 +0000 (UTC) (envelope-from royger@FreeBSD.org) Received: from localhost (87.red-83-59-60.dynamicip.rima-tde.net [83.59.60.87]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) (Authenticated sender: royger) by smtp.freebsd.org (Postfix) with ESMTPSA id 2D3B621F5F; Sat, 19 May 2018 08:02:57 +0000 (UTC) (envelope-from royger@FreeBSD.org) Date: Sat, 19 May 2018 10:02:50 +0200 From: Roger Pau =?utf-8?B?TW9ubsOp?= To: Nathan Friess Cc: freebsd-xen@freebsd.org Subject: Re: Linux domU only works with xen_platform_pci=0 ? Message-ID: <20180519080250.67fl66gqbew7xfzp@MacBook-Pro-de-Roger.local> References: <20180513151649.4ls73myegkhm3cep@MacBook-Pro-de-Roger.local> <0749df4b-1614-dcdf-1bf2-1bbad1ae5743@duckster.net> <20180514130445.ahqk5ol3kdhriqju@MacBook-Pro-de-Roger.local> <6c0e1f5a-3e7d-054e-298c-5ec3d97e6141@gmail.com> <20180515080836.kufr3q3mk5mxwx4q@MacBook-Pro-de-Roger.local> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: User-Agent: NeoMutt/20180323 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.26 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 19 May 2018 08:02:59 -0000 On Thu, May 17, 2018 at 06:10:15PM -0600, Nathan Friess wrote: > On 2018-05-15 02:08 AM, Roger Pau Monné wrote: > > On Mon, May 14, 2018 at 08:34:54PM -0600, Nathan Friess wrote: > > > > > > I had similar issues with Linux domUs being unable to detect their disks > > > when FreeBSD 11.1-RELEASE is the backend: > > > > > > https://lists.freebsd.org/pipermail/freebsd-xen/2016-December/002924.html > > > > > > > > > What seems to be happening is that on my system the frontend and backend may > > > go from state InitWait to Initialised in different orders and so either end > > > may end up getting stuck waiting for the other side to change state when the > > > other side already has done so. > > > > > > I have been running with the attached patch since my last message above and > > > Linux domUs have been working perfectly since then. I realize that the call > > > to pause() is not the correct solution but it demonstrates that some fine > > > tuning of how the states are handled will help. > > > > Can you please give a try to the patch at: > > > > https://lists.freebsd.org/pipermail/freebsd-xen/2018-May/003132.html > > > > I think this is the proper way to solve the issue, and I would like to > > commit it ASAP in order to MFC it to stable-11 before 11.2 is > > released, but it could benefit from some more testing. > > > > Thanks, Roger. > > > > > I tried the patch on and I my Linux domU did was not able to complete the > attachment to the FreeBSD backend. I applied the patch to the 11-RELEASE > kernel. (I couldn't get 11-STABLE to compile.) > > With xen_platform_pci=0 the frontend and backend vbds were both stuck in > state 1. With xen_platform_pci=1 the frontend was in state 1 and backend in > state 3. Thanks for the testing! I however think you had some issue applying the patch or building/installing the kernel, with the attached patch the backend should never go into state 3. Can you confirm that you have the patch correctly applied to the kernel you are running? And if so, can you try to debug why the backend goes into state 3? FWIW, the patch works fine for me and I've been able to boot Debian and Alpine Linux guests without having to add xen_platform_pci=0. Thanks, Roger. From owner-freebsd-xen@freebsd.org Sat May 19 08:11:06 2018 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2E402EF30AC for ; Sat, 19 May 2018 08:11:06 +0000 (UTC) (envelope-from prvs=6704938b3=roger.pau@citrix.com) Received: from SMTP.EU.CITRIX.COM (smtp.ctxuk.citrix.com [185.25.65.24]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.citrix.com", Issuer "DigiCert SHA2 Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 58073852B4; Sat, 19 May 2018 08:11:04 +0000 (UTC) (envelope-from prvs=6704938b3=roger.pau@citrix.com) X-IronPort-AV: E=Sophos;i="5.49,417,1520899200"; d="scan'208";a="73401743" Date: Sat, 19 May 2018 10:10:30 +0200 From: Roger Pau =?utf-8?B?TW9ubsOp?= To: Pratyush Yadav CC: FreeBSD-Xen , Akshay Jaggi , Edward Napierala Subject: Re: Xen kernel fails to boot, d0v1 triple fault looks like the cuplrit Message-ID: <20180519081030.qhzyjdrpwcekmcac@MacBook-Pro-de-Roger.local> References: MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Disposition: inline In-Reply-To: User-Agent: NeoMutt/20180323 X-ClientProxiedBy: AMSPEX02CAS01.citrite.net (10.69.22.112) To AMSPEX02CL02.citrite.net (10.69.22.126) X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.26 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 19 May 2018 08:11:06 -0000 On Fri, May 18, 2018 at 05:29:06PM +0530, Pratyush Yadav wrote: > Hi, > > So I have been trying to get Xen to boot on my laptop. It is getting > stuck with the following error messages: > > (XEN) Scrubbing free RAM on 1 nodes using 4 CPUs > (XEN) [VT-D] DMAR: [DMA Read} Request device [0000:00:1a.0] fault addr > 9ce13000. iommu reg - ffff82c000203000 > (XEN) [VT-D] DMAR: reason 06 - PTE read access is not set > (XEN) ........... done > (XEN) initial low memory virq threshold set at 0x200 pages. > (XEN) Std. Loglevel: All > (XEN) Guest Loglevel: All > (XEN) Xen is keeping VGA console > (XEN) Boot video device 00:02.0 > (XEN) ***Serial input -> DOM0 (type 'CTRL-a' three times to switch input to Xen) > (XEN) Freed 320 kB init memory > FreeBSD PVH running on xen-3.0-x86_64p > Copyright (c) 1992-2018 The FreeBSD Project. > Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, > 1994 The regents of the University of California. All rights reserved. > FreeBSD is a registered trademark of The FreeBSD Foundation. > FreeBSD 12.0-CURRENT #0 r333606: Mon May 14 19:59:08 UTC 2018 > root@releng3.nyi.freebsd.org:/usr/obj/usr/src/amd64.amd64/sys/GENERIC amd64 > WARNING: WITNESS option enabled, expect reduced performance. > VT(vga): text 80x25 > CPU: Intel(R) Core(TM) i7-4710HQ CPU @ 2.50GHz (2494.22-MHz K8-class CPU) > Origin="GenuineIntel" Id=0x306c3 Family=0x6 Model=0x3c Stepping=3 > Features=0x17c1cbf5 FXSR,SSE,SSE2,HTT> > Features2=0xf6f83203 POPCNT,AESNI,XSAVE,AVX,F16C,RDRAND,HV> > AMD Features=0x20101800NX,LM> > AMD Features2=0x21< > Structured Extended Features=0x2329 > Hypervisor: Origin = "XenVMMXenVMM" > real memory = 9991770112 (9528 MB) > avail memory = 7936724992 (7569 MB) > (XEN) d0v1 Triple fault - invoking HVM shutdown action 0 > (XEN) *** Dumping Dom0 vcpu#1 state: *** > (XEN) ----[ Xen-4.7.2 x86_64 debug=n Not tainted ]---- > (XEN) CPU: 1 > (XEN) RIP: 0020:[] > (XEN) RFLAGS: 0000000000010016 CONTEXT: hvm guest (d0v1) > (XEN) rax: 0000000000000000 rbx: ffffffff8201c100 rcx: 0000000000000001 > (XEN) rdx: 0000000000003078 rsi: ffffffff81b992f8 rdi: fffffe0003bb6078 > (XEN) rbp: fffffe00009ffff0 rsp: fffffe00009fffa0 r8: 00000000ffffffff > (XEN) r15: 0000000000000400 cr0: 0000000000000011 cr4: 0000000000000020 > (XEN) cr3: 00000000035a4000 cr2: 0000000000000ff0 > (XEN) ds: 0028 es: 0028 fs: 0028 gs: 0028 ss: 0028 cs: 0020 > (XEN) Guest stack trace from rsp=fffffe00009fffa0: > (XEN) Fault while accessing guest memory. > (XEN) Hardware Dom0 halted: halting machine > > Any idea why this is happening and how can I fix this? Can you execute: addr2line -e /usr/lib/debug/boot/kernel/kernel.debug ffffffff8102042b This should print a file and line number that would help in order to debug what's going on. Since it seems like the crash is caused by a triple fault on an AP, you can try to boot with dom0_max_vcpus=1 on the xen_cmdline, that might prevent the panic from happening. We need however to figure out what's going on and fix it. Thanks, Roger. From owner-freebsd-xen@freebsd.org Sat May 19 10:15:56 2018 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0665DEF5488 for ; Sat, 19 May 2018 10:15:56 +0000 (UTC) (envelope-from pratiy0100@gmail.com) Received: from mail-wm0-x242.google.com (mail-wm0-x242.google.com [IPv6:2a00:1450:400c:c09::242]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 72B896847D; Sat, 19 May 2018 10:15:55 +0000 (UTC) (envelope-from pratiy0100@gmail.com) Received: by mail-wm0-x242.google.com with SMTP id f6-v6so17891126wmc.4; Sat, 19 May 2018 03:15:55 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=KF5mvJea5O/I8+qHo5dGmv3uK9GMH8+S7MYTfc7YeJA=; b=sfc8ENFozln4CJ5E2vaJjZ9ZF8Fo/uKmm7RGL1N5QvsnL93YMmXfwTYVuLm6Z0cYXZ 8SBuJiTyVQyUSyAbHkymf7pZNuF2rXuLPXy6aFP/Wt6xirrQTIlSGS1493Ky9H21KROo 4seakfxkrLtEV/eXOtZBZHbOnb56QiKg18tAW2M47pyskhK4WbntWrlqjeyr4ZZyhpvL z1e2nfdqYVYioGR1xEO3I5Idj2tvhGaRHCM6ak/BM/gd7vXYj+bXdsF3JMcC0p8X07kg XTMBmwVv50deU8wYzb6ABuB7eDZwwkMa6ezWPGLFCKnVpmIrqd66z1As1q0Np2CJJXwB w1Fg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=KF5mvJea5O/I8+qHo5dGmv3uK9GMH8+S7MYTfc7YeJA=; b=jgT8B1FOXpNe/+xFtA9RcTT+61/kuh3SifPOKKw9K9cwQhpAXlkEcSvi3I4rxBnsEE lKEjt22HhZTyfudtHUDeDKEZ2uoVhEW9Y/yI4fZt6xtNQnTSd0a5r57LL3hP9b7YjHOg fD50NjG6Upp8lMR4vohrsdiVVJy8h1OcgylMl/wX0WYHrYnWUgWk5MYzW54TAnbXzBVx 8OQy8E/rgm3K/kZUiXgY7CSWc9krf1jys024xDxg++cdzUgUDc33XMhr3Cu21FQTijcu JrplfyxdG2CtZI9kj/yLINj3hnfDAAAcbhgV+L9woi4k+fMlLEeUjM9L/m//Y0kZr7SJ AX7g== X-Gm-Message-State: ALKqPwfGS/yyqsTwE4AKakyavm3/3Nd3BC6cQfbbvK582YZ4GFJ7rMW1 qdtf7GFLNudVqh4evXgrR+LLXP2nDN1f4z8sOdc= X-Google-Smtp-Source: AB8JxZrHgAqj/xXlRCw9XufLaY6e+swLGuZxX+Rf3pAXyjS8cf+vW4j9RSq1abGMFk8F+umCaYSxRTvV6bwPNRpTmtM= X-Received: by 2002:a50:f5cd:: with SMTP id x13-v6mr15303604edm.132.1526724954387; Sat, 19 May 2018 03:15:54 -0700 (PDT) MIME-Version: 1.0 References: <20180519081030.qhzyjdrpwcekmcac@MacBook-Pro-de-Roger.local> In-Reply-To: <20180519081030.qhzyjdrpwcekmcac@MacBook-Pro-de-Roger.local> From: Pratyush Yadav Date: Sat, 19 May 2018 15:45:41 +0530 Message-ID: Subject: Re: Xen kernel fails to boot, d0v1 triple fault looks like the cuplrit To: =?UTF-8?Q?Roger_Pau_Monn=C3=A9?= Cc: freebsd-xen@freebsd.org, Akshay Jaggi , Edward Napierala Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.26 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.26 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 19 May 2018 10:15:56 -0000 Hi, The line is /usr/src/sys/amd64/amd64/mp_machdep.c:307 Also, I tried with dom0_max_vcpus=3D1 but it keeps rebooting (despite noreboot in the xen command line) On Sat 19 May, 2018, 1:40 PM Roger Pau Monn=C3=A9, w= rote: > On Fri, May 18, 2018 at 05:29:06PM +0530, Pratyush Yadav wrote: > > Hi, > > > > So I have been trying to get Xen to boot on my laptop. It is getting > > stuck with the following error messages: > > > > (XEN) Scrubbing free RAM on 1 nodes using 4 CPUs > > (XEN) [VT-D] DMAR: [DMA Read} Request device [0000:00:1a.0] fault addr > > 9ce13000. iommu reg - ffff82c000203000 > > (XEN) [VT-D] DMAR: reason 06 - PTE read access is not set > > (XEN) ........... done > > (XEN) initial low memory virq threshold set at 0x200 pages. > > (XEN) Std. Loglevel: All > > (XEN) Guest Loglevel: All > > (XEN) Xen is keeping VGA console > > (XEN) Boot video device 00:02.0 > > (XEN) ***Serial input -> DOM0 (type 'CTRL-a' three times to switch inpu= t > to Xen) > > (XEN) Freed 320 kB init memory > > FreeBSD PVH running on xen-3.0-x86_64p > > Copyright (c) 1992-2018 The FreeBSD Project. > > Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, > > 1994 The regents of the University of California. All rights reserved. > > FreeBSD is a registered trademark of The FreeBSD Foundation. > > FreeBSD 12.0-CURRENT #0 r333606: Mon May 14 19:59:08 UTC 2018 > > root@releng3.nyi.freebsd.org:/usr/obj/usr/src/amd64.amd64/sys/GENER= IC > amd64 > > WARNING: WITNESS option enabled, expect reduced performance. > > VT(vga): text 80x25 > > CPU: Intel(R) Core(TM) i7-4710HQ CPU @ 2.50GHz (2494.22-MHz K8-class CP= U) > > Origin=3D"GenuineIntel" Id=3D0x306c3 Family=3D0x6 Model=3D0x3c Step= ping=3D3 > > > Features=3D0x17c1cbf5 > FXSR,SSE,SSE2,HTT> > > > Features2=3D0xf6f83203 > POPCNT,AESNI,XSAVE,AVX,F16C,RDRAND,HV> > > AMD Features=3D0x20101800NX,LM> > > AMD Features2=3D0x21< > > Structured Extended > Features=3D0x2329 > > Hypervisor: Origin =3D "XenVMMXenVMM" > > real memory =3D 9991770112 (9528 MB) > > avail memory =3D 7936724992 (7569 MB) > > (XEN) d0v1 Triple fault - invoking HVM shutdown action 0 > > (XEN) *** Dumping Dom0 vcpu#1 state: *** > > (XEN) ----[ Xen-4.7.2 x86_64 debug=3Dn Not tainted ]---- > > (XEN) CPU: 1 > > (XEN) RIP: 0020:[] > > (XEN) RFLAGS: 0000000000010016 CONTEXT: hvm guest (d0v1) > > (XEN) rax: 0000000000000000 rbx: ffffffff8201c100 rcx: > 0000000000000001 > > (XEN) rdx: 0000000000003078 rsi: ffffffff81b992f8 rdi: > fffffe0003bb6078 > > (XEN) rbp: fffffe00009ffff0 rsp: fffffe00009fffa0 r8: > 00000000ffffffff > > (XEN) r15: 0000000000000400 cr0: 0000000000000011 cr4: > 0000000000000020 > > (XEN) cr3: 00000000035a4000 cr2: 0000000000000ff0 > > (XEN) ds: 0028 es: 0028 fs: 0028 gs: 0028 ss: 0028 cs: 0020 > > (XEN) Guest stack trace from rsp=3Dfffffe00009fffa0: > > (XEN) Fault while accessing guest memory. > > (XEN) Hardware Dom0 halted: halting machine > > > > Any idea why this is happening and how can I fix this? > > Can you execute: > > addr2line -e /usr/lib/debug/boot/kernel/kernel.debug ffffffff8102042b > > This should print a file and line number that would help in order to > debug what's going on. > > Since it seems like the crash is caused by a triple fault on an AP, > you can try to boot with dom0_max_vcpus=3D1 on the xen_cmdline, that > might prevent the panic from happening. > > We need however to figure out what's going on and fix it. > > Thanks, Roger. > From owner-freebsd-xen@freebsd.org Sat May 19 10:26:49 2018 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 21324EF580C for ; Sat, 19 May 2018 10:26:49 +0000 (UTC) (envelope-from pratiy0100@gmail.com) Received: from mail-wm0-x22d.google.com (mail-wm0-x22d.google.com [IPv6:2a00:1450:400c:c09::22d]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 711D168A78; Sat, 19 May 2018 10:26:48 +0000 (UTC) (envelope-from pratiy0100@gmail.com) Received: by mail-wm0-x22d.google.com with SMTP id t11-v6so18014620wmt.0; Sat, 19 May 2018 03:26:48 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=aolK66lXLyHfcQqwY9t3SRde8ppwzG1qlHGrsNiMJJg=; b=fjBDQc1PFdnk/s59lXm126GcWEg9YlfLJsV2sJWChyzyGyhmIbh0qvD8a4KtlUfr15 4bWb2cwkAujXOsAw94YOgmSL1/PSeJMXdyuXl3vBoLTYa443/DkBuuU7H5tNfCPFk/p0 5LNyQF1MNV8mWB3QXksd0DZQNDFs7pyW9NFEqJDfSE5v3OpbdUXhRFCb0AyjP/w9zk3P gpdb47cD+IrpepeixltX3zV4zGvmykaZ0BciWyREFfK8oF7Kv9t9sZlTRQy83amIqKyA HaRALZ1k8a/fJx6fOVqD7T2PEscOG5R2E1CjHik4QxG4meI8PicGIWLD09nZQgQeZygy hBZQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=aolK66lXLyHfcQqwY9t3SRde8ppwzG1qlHGrsNiMJJg=; b=CfnSAxvjKRFZLx8P4vP2GMlx/XdtqaXSi5U+IauMiEfj6Wm9PmkBz1nS2a597xXXn7 /hI6+RREc1Gv3v4XlEQN9fAlbJ22WNQI02mDbSq8nNzY93FimX5ms/azPcdVaNnr3emF yMunb/EZp7RN+J6BVAgsJT4uDLVc/RNrqRc003UpnGR9hzsNO0wCfT2O5UCgJOu+iXZS zwuYr9FLe7Wfsqb+y5hpjUmMtVI1Ku1ucpC38Idj93Zi1N+zM/ROA6hUskZA9kExigzE lOiTHmnn+Sk9cX87RbbLFOOq7nrXBGfT96CbA+H+ZGa6NbAkRfGAdfozK2UGXnL3cfmK p/zA== X-Gm-Message-State: ALKqPweMAnV/c5zEHgkoqOvg9xraL3TrM14dDZHQnLtO/mjHz71zJiAY Fup08/Eocr339Y3mkxmo6jS7Fq/y8+kpvSudoPzhZQ== X-Google-Smtp-Source: AB8JxZpIDCvE+4c491UbZE3watGEJ+iNEAGNkKOx7TEhgiYl2mwVDrjLd/QHJWdOUiGC9ZwYJ3piIyQSImox2kZfsHk= X-Received: by 2002:a50:9953:: with SMTP id l19-v6mr15733118edb.179.1526725607267; Sat, 19 May 2018 03:26:47 -0700 (PDT) MIME-Version: 1.0 References: <8B64FF6E-78C5-4803-ACE0-D569EA5FDAB2@FreeBSD.org> In-Reply-To: From: Pratyush Yadav Date: Sat, 19 May 2018 15:56:35 +0530 Message-ID: Subject: Re: Xen kernel fails to boot, d0v1 triple fault looks like the cuplrit To: Akshay Jaggi Cc: freebsd-xen@freebsd.org Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.26 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.26 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 19 May 2018 10:26:49 -0000 Hi, On Fri 18 May, 2018, 6:55 PM Akshay Jaggi, wrote: > Looks to me like a configuration error. Worst case, incompatible hardware= . > Iirc, you mentioned Xen and Freebsd were on a USB drive. Can you try usin= g > a hard drive partition? > Also, there was an option to enable verbose logging. > I installed on my HDD, but it makes no difference. Also, I have set log level to all, still the logs are not being saved. Regards, > Akshay > > On Fri 18 May, 2018, 2:13 PM Edward Tomasz Napiera=C5=82a, > wrote: > >> >> > On 18 May 2018, at 12:59, Pratyush Yadav wrote: >> > >> > Hi, >> > >> > So I have been trying to get Xen to boot on my laptop. It is getting >> > stuck with the following error messages: >> > >> > (XEN) Scrubbing free RAM on 1 nodes using 4 CPUs >> > (XEN) [VT-D] DMAR: [DMA Read} Request device [0000:00:1a.0] fault addr >> > 9ce13000. iommu reg - ffff82c000203000 >> > (XEN) [VT-D] DMAR: reason 06 - PTE read access is not set >> > (XEN) ........... done >> > (XEN) initial low memory virq threshold set at 0x200 pages. >> > (XEN) Std. Loglevel: All >> > (XEN) Guest Loglevel: All >> > (XEN) Xen is keeping VGA console >> > (XEN) Boot video device 00:02.0 >> > (XEN) ***Serial input -> DOM0 (type 'CTRL-a' three times to switch >> input to Xen) >> > (XEN) Freed 320 kB init memory >> > FreeBSD PVH running on xen-3.0-x86_64p >> > Copyright (c) 1992-2018 The FreeBSD Project. >> > Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, >> > 1994 The regents of the University of California. All rights reserved. >> > FreeBSD is a registered trademark of The FreeBSD Foundation. >> > FreeBSD 12.0-CURRENT #0 r333606: Mon May 14 19:59:08 UTC 2018 >> > root@releng3.nyi.freebsd.org:/usr/obj/usr/src/amd64.amd64/sys/GENER= IC >> amd64 >> > WARNING: WITNESS option enabled, expect reduced performance. >> > VT(vga): text 80x25 >> > CPU: Intel(R) Core(TM) i7-4710HQ CPU @ 2.50GHz (2494.22-MHz K8-class >> CPU) >> > Origin=3D"GenuineIntel" Id=3D0x306c3 Family=3D0x6 Model=3D0x3c Step= ping=3D3 >> > >> Features=3D0x17c1cbf5> > FXSR,SSE,SSE2,HTT> >> > >> Features2=3D0xf6f83203> > POPCNT,AESNI,XSAVE,AVX,F16C,RDRAND,HV> >> > AMD Features=3D0x20101800NX,LM> >> > AMD Features2=3D0x21< >> > Structured Extended >> Features=3D0x2329 >> > Hypervisor: Origin =3D "XenVMMXenVMM" >> > real memory =3D 9991770112 (9528 MB) >> > avail memory =3D 7936724992 (7569 MB) >> > (XEN) d0v1 Triple fault - invoking HVM shutdown action 0 >> > (XEN) *** Dumping Dom0 vcpu#1 state: *** >> > (XEN) ----[ Xen-4.7.2 x86_64 debug=3Dn Not tainted ]---- >> > (XEN) CPU: 1 >> > (XEN) RIP: 0020:[] >> > (XEN) RFLAGS: 0000000000010016 CONTEXT: hvm guest (d0v1) >> > (XEN) rax: 0000000000000000 rbx: ffffffff8201c100 rcx: >> 0000000000000001 >> > (XEN) rdx: 0000000000003078 rsi: ffffffff81b992f8 rdi: >> fffffe0003bb6078 >> > (XEN) rbp: fffffe00009ffff0 rsp: fffffe00009fffa0 r8: >> 00000000ffffffff >> > (XEN) r15: 0000000000000400 cr0: 0000000000000011 cr4: >> 0000000000000020 >> > (XEN) cr3: 00000000035a4000 cr2: 0000000000000ff0 >> > (XEN) ds: 0028 es: 0028 fs: 0028 gs: 0028 ss: 0028 cs: 0020 >> > (XEN) Guest stack trace from rsp=3Dfffffe00009fffa0: >> > (XEN) Fault while accessing guest memory. >> > (XEN) Hardware Dom0 halted: halting machine >> > >> > Any idea why this is happening and how can I fix this? >> >> First thing I=E2=80=99d try is to checkout an earlier version - eg from = three >> months ago) and see if it persist. Another thing to do (in parallel) is= to >> file a PR (http://bugs.freebsd.org). >> >> From owner-freebsd-xen@freebsd.org Sat May 19 11:31:53 2018 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C5AB8EAA86F for ; Sat, 19 May 2018 11:31:53 +0000 (UTC) (envelope-from pratiy0100@gmail.com) Received: from mail-wm0-x241.google.com (mail-wm0-x241.google.com [IPv6:2a00:1450:400c:c09::241]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 451F76C024; Sat, 19 May 2018 11:31:53 +0000 (UTC) (envelope-from pratiy0100@gmail.com) Received: by mail-wm0-x241.google.com with SMTP id j5-v6so19348997wme.5; Sat, 19 May 2018 04:31:53 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-transfer-encoding; bh=zb//Hr/wHCnZLdbFwwIV7cNQjS4a3sSDv1b7fqOgk/4=; b=WffHttQFKyPoD8Tb9aXLKon9aYDiFoeFmg4WiR+dVz+jQyZLS1xParsDO4reoM3fsL 1VrqNsU0zoIz/ZPua7zhCwueylRhjKbixcTk4NjxRWd1+9EBpPhJ3pbjqFVaG9w+2CKc mhI/yBcyZ1hAcA9ZVQPfR2LAh3bMW366mA1Hf1WhslhNlSviD6OugmiH0SdG4dO1Wdm1 JepKudoaIStosyF05UTr9CtiVWl1TDjY6EK5alq7/9s07XUwH/n9VxppYfK0rGqogIlG APiC4g4HTIStf64Ic1T/KUn7gZ0PZpQLV+P0LXY2MqMpe9YxEM8LCdRKu3Vy6r7nft3i CJBQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=zb//Hr/wHCnZLdbFwwIV7cNQjS4a3sSDv1b7fqOgk/4=; b=ZwLUyo0TSWMM666Ot3+Eiqw0u63DiWJ7FuD2cJNl0/WDBxSMs/HJWtApn73EhBA8s7 u67wh1EngYa+s+gFbpWjA+pOntLKT0b3UcAQ17Zx0m9iq+6k9Wr/Er0716ifjoLbBgII 3IxPtBZZMx/EafRUZ6Z/BnhJLtJD2tDhUV78p6LYJ4O5N7tMFau0HihelkhdNhbkHGcY K7iE9BZmd7zQwCk8DcEw4OnKiFrZePyk2ZxAWGz34F6mCO1IeUn5cjqXq5ry941AlYmJ X1xWerBKh7XPE9lF8B+p0N3ReFsiK7ybEqf1KDB9oKlFKaQ8erQtVYHxsmTrwkG4Id7A K1vw== X-Gm-Message-State: ALKqPwd+eMvzEFm8GrohLdIo9LIEFKEJaQDt1LkJHoSmT6YvBIz1G7AI nsBE2JXDxn0pLfqN8Q5tKZL+YHt1qxkOb67Gxl4= X-Google-Smtp-Source: AB8JxZp8SzoWAosvHqTLtVqywjhMYOV1clUmYYlQVzazVKR+YkL6nfUWEqGNCr7ZUolPkxDjcc19fvOlpyFFmNYm7ds= X-Received: by 2002:a50:b119:: with SMTP id k25-v6mr16194917edd.217.1526729511532; Sat, 19 May 2018 04:31:51 -0700 (PDT) MIME-Version: 1.0 Received: by 10.80.170.33 with HTTP; Sat, 19 May 2018 04:31:11 -0700 (PDT) In-Reply-To: References: <20180519081030.qhzyjdrpwcekmcac@MacBook-Pro-de-Roger.local> From: Pratyush Yadav Date: Sat, 19 May 2018 17:01:11 +0530 Message-ID: Subject: Re: Xen kernel fails to boot, d0v1 triple fault looks like the cuplrit To: =?UTF-8?Q?Roger_Pau_Monn=C3=A9?= Cc: FreeBSD-Xen , Akshay Jaggi , Edward Napierala Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.26 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 19 May 2018 11:31:54 -0000 On Sat, May 19, 2018 at 3:45 PM, Pratyush Yadav wrot= e: > Hi, > > The line is > > /usr/src/sys/amd64/amd64/mp_machdep.c:307 > > Also, I tried with dom0_max_vcpus=3D1 but it keeps rebooting (despite nor= eboot > in the xen command line) Correction: It boots with dom0_max_vcpus=3D1. It did not boot for me earlier because I was trying to fix it by trying to make Xen from source so I had actually deinstalled it when I tested with max_vcpus=3D1. Now I reinstalled Xen and it works. Thanks for the temporary workaround! Let me know if you want more info about the panic. > > On Sat 19 May, 2018, 1:40 PM Roger Pau Monn=C3=A9, = wrote: >> >> On Fri, May 18, 2018 at 05:29:06PM +0530, Pratyush Yadav wrote: >> > Hi, >> > >> > So I have been trying to get Xen to boot on my laptop. It is getting >> > stuck with the following error messages: >> > >> > (XEN) Scrubbing free RAM on 1 nodes using 4 CPUs >> > (XEN) [VT-D] DMAR: [DMA Read} Request device [0000:00:1a.0] fault addr >> > 9ce13000. iommu reg - ffff82c000203000 >> > (XEN) [VT-D] DMAR: reason 06 - PTE read access is not set >> > (XEN) ........... done >> > (XEN) initial low memory virq threshold set at 0x200 pages. >> > (XEN) Std. Loglevel: All >> > (XEN) Guest Loglevel: All >> > (XEN) Xen is keeping VGA console >> > (XEN) Boot video device 00:02.0 >> > (XEN) ***Serial input -> DOM0 (type 'CTRL-a' three times to switch inp= ut >> > to Xen) >> > (XEN) Freed 320 kB init memory >> > FreeBSD PVH running on xen-3.0-x86_64p >> > Copyright (c) 1992-2018 The FreeBSD Project. >> > Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, >> > 1994 The regents of the University of California. All rights reserved. >> > FreeBSD is a registered trademark of The FreeBSD Foundation. >> > FreeBSD 12.0-CURRENT #0 r333606: Mon May 14 19:59:08 UTC 2018 >> > >> > root@releng3.nyi.freebsd.org:/usr/obj/usr/src/amd64.amd64/sys/GENERIC = amd64 >> > WARNING: WITNESS option enabled, expect reduced performance. >> > VT(vga): text 80x25 >> > CPU: Intel(R) Core(TM) i7-4710HQ CPU @ 2.50GHz (2494.22-MHz K8-class >> > CPU) >> > Origin=3D"GenuineIntel" Id=3D0x306c3 Family=3D0x6 Model=3D0x3c Ste= pping=3D3 >> > >> > Features=3D0x17c1cbf5> > FXSR,SSE,SSE2,HTT> >> > >> > Features2=3D0xf6f83203> > POPCNT,AESNI,XSAVE,AVX,F16C,RDRAND,HV> >> > AMD Features=3D0x20101800NX,LM> >> > AMD Features2=3D0x21< >> > Structured Extended >> > Features=3D0x2329 >> > Hypervisor: Origin =3D "XenVMMXenVMM" >> > real memory =3D 9991770112 (9528 MB) >> > avail memory =3D 7936724992 (7569 MB) >> > (XEN) d0v1 Triple fault - invoking HVM shutdown action 0 >> > (XEN) *** Dumping Dom0 vcpu#1 state: *** >> > (XEN) ----[ Xen-4.7.2 x86_64 debug=3Dn Not tainted ]---- >> > (XEN) CPU: 1 >> > (XEN) RIP: 0020:[] >> > (XEN) RFLAGS: 0000000000010016 CONTEXT: hvm guest (d0v1) >> > (XEN) rax: 0000000000000000 rbx: ffffffff8201c100 rcx: >> > 0000000000000001 >> > (XEN) rdx: 0000000000003078 rsi: ffffffff81b992f8 rdi: >> > fffffe0003bb6078 >> > (XEN) rbp: fffffe00009ffff0 rsp: fffffe00009fffa0 r8: >> > 00000000ffffffff >> > (XEN) r15: 0000000000000400 cr0: 0000000000000011 cr4: >> > 0000000000000020 >> > (XEN) cr3: 00000000035a4000 cr2: 0000000000000ff0 >> > (XEN) ds: 0028 es: 0028 fs: 0028 gs: 0028 ss: 0028 cs: 0020 >> > (XEN) Guest stack trace from rsp=3Dfffffe00009fffa0: >> > (XEN) Fault while accessing guest memory. >> > (XEN) Hardware Dom0 halted: halting machine >> > >> > Any idea why this is happening and how can I fix this? >> >> Can you execute: >> >> addr2line -e /usr/lib/debug/boot/kernel/kernel.debug ffffffff8102042b >> >> This should print a file and line number that would help in order to >> debug what's going on. >> >> Since it seems like the crash is caused by a triple fault on an AP, >> you can try to boot with dom0_max_vcpus=3D1 on the xen_cmdline, that >> might prevent the panic from happening. >> >> We need however to figure out what's going on and fix it. >> >> Thanks, Roger. --=20 Regards, Pratyush Yadav