From owner-freebsd-xen@FreeBSD.ORG Thu Dec 4 21:28:14 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id EF113D33 for ; Thu, 4 Dec 2014 21:28:14 +0000 (UTC) Received: from mail-ig0-x22c.google.com (mail-ig0-x22c.google.com [IPv6:2607:f8b0:4001:c05::22c]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id A84528A5 for ; Thu, 4 Dec 2014 21:28:14 +0000 (UTC) Received: by mail-ig0-f172.google.com with SMTP id hl2so19414670igb.11 for ; Thu, 04 Dec 2014 13:28:13 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=dpdtech.com; s=google; h=content-type:mime-version:subject:from:in-reply-to:date:cc :message-id:references:to; bh=2FlV+S7BsT/akz50o6yuT5OBzLLbq77M8rLYPpaMxWM=; b=Ec+i69tFCj3KQaIPJt8IAARhYQRuVpFyhEULD2IFyBf8BIPe6e6GFIhNfqVXw3IEOL FGjrb9JjLuGFbyttl9D67VYAx0suM+RUiiWsqEy2hOqdTjYPZMvzu/lEXPLgpIfTKyLU QhXAZGafbJObQ5tUgLjGEOBF0pT06/f4GMQ5U= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:content-type:mime-version:subject:from :in-reply-to:date:cc:message-id:references:to; bh=2FlV+S7BsT/akz50o6yuT5OBzLLbq77M8rLYPpaMxWM=; b=AgLgFBPmmWy0JLA6w6FoXQp9WBhj/GJG5c38/qVn5EpAGrJM3OOYQR6TBWTbW09HKo ykamZ1It+OMaioNbDJnqGa/05kuNWclmtzOXJoE5SDz7T+Mw1EWLJvnPogCtLNnYENje Vh906cGWEIA23/9Qv/avTYYJ7eISpYo3YTJ86yiCVrQ9rAf+Mb++SViW302YeC3uFw5l tY8bRqFIeS9UTPUTZVkfhBFzW4ZbJnzxKF6rXTnSwhj1IRxgCCZvQaNmJlly3wVczhUE 9ZzOGzx0ls47YcvLx+7nDAvLKTtKvyFmDvETDeVX4MckO0NTst2/+4Cx3JTBgdG9qsLa 4u9w== X-Gm-Message-State: ALoCoQk34KjcKAuxDNdbnqzdlIrmvtFSg4ibSaXqmjUMVpai2y/baX9YcfrL37HdVxr2jSfFZYvy X-Received: by 10.50.142.98 with SMTP id rv2mr3427051igb.19.1417728493751; Thu, 04 Dec 2014 13:28:13 -0800 (PST) Received: from 173-13-188-41-sfba.hfc.comcastbusiness.net (173-13-188-41-sfba.hfc.comcastbusiness.net. [173.13.188.41]) by mx.google.com with ESMTPSA id ik2sm15894297igb.9.2014.12.04.13.28.13 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Thu, 04 Dec 2014 13:28:13 -0800 (PST) Content-Type: multipart/signed; boundary="Apple-Mail=_ED4F376F-2810-47D9-BE3A-9BF54115C362"; protocol="application/pgp-signature"; micalg=pgp-sha512 Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.6\)) Subject: Re: Attempting to Get Xen FreeBSD Dom0 working From: "David P. Discher" In-Reply-To: Date: Thu, 4 Dec 2014 13:28:12 -0800 Message-Id: References: <481F7D02-BFE9-4E35-A475-5A8A05A801CE@dpdtech.com> <547DFCC0.6030003@citrix.com> <547F1476.8080305@citrix.com> <29437DB9-7DC8-47A8-8FC4-2BFDE736B5BC@dpdtech.com> <547F59B4.1010105@citrix.com> <2DDCAA68-3B11-4E3C-AE61-EAD8CEEF1E2D@dpdtech.com> <547F6AC1.9060709@citrix.com> <7C356027-01D8-4800-B211-282566BC9871@dpdtech.com> <54801F77.5050700@citrix.com> To: =?iso-8859-1?Q?Roger_Pau_Monn=E9?= X-Mailer: Apple Mail (2.1878.6) Cc: freebsd-xen@freebsd.org X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 04 Dec 2014 21:28:15 -0000 --Apple-Mail=_ED4F376F-2810-47D9-BE3A-9BF54115C362 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=windows-1252 Update: So, I changed a few things, and stuff is working better. The Xen kernel line is now: dom0_mem=3D2048M dom0_max_vcpus=3D4 dom0pvh=3D1 sync_console = com1=3D115200,8n1,0x3e8 console=3Dvga,com1 iommu=3Ddebug Also note, I have these set in FreeBSD: console=3D"comconsole vidconsole" comconsole_speed=3D"115200" comconsole_port=3D"0x3e8" boot_multicons=3D"yes" vm.max_wired=3D2097152 verbose_loading=3D"YES" boot_verbose=3D"" # -v: Causes extra debugging information to be = printed hint.ahci.0.msi=3D0 hw.acpi.verbose=3D1 debug.acpi.enable_debug_objects=3D1 So far, no AHCI timeouts. I=92v gotten completely through an install of = Debian =85 granted it failed, but for a linux reasons - couldn=92t = find/download a package. But is still going. The change to the console lines also help =85 console=3Dvga,com1 & = sync_console to xen allowed the IPMI SOL COM3 to fully complete the boot = under freebsd. And the tty/login ran and displayed on xc0 : FreeBSD/amd64 (borg.dpdtech.com) (xc0) However, this console will not take any input. I still can=92t get = switched into the Xen console (Ctrl-A x3) on either the serial of VGA = consoles.=20 Another troubling item, em0 flaps when debian is starting up: xnb(xnb_probe:1144): Claiming device 0, xnb xnb1.0: bpf attached xnb(xnb_attach:1292): Attaching to backend/vif/1/0 xnb(xnb_frontend_changed:1416): frontend_state=3DInitialising, = xnb_state=3DInitWait em0: Link is Down xnb1.0: 2 link states coalesced (d1) mapping kernel into physical memory (d1) about to get started... xnb(xnb_frontend_changed:1416): frontend_state=3DConnected, = xnb_state=3DInitWait xnb(xnb_connect_comms:796): rings connected! em0: Link is up 1000 Mbps Full Duplex em0 is in bridge0, which is what the debian.cfg is using. Also, something really odd =85 hyper calls aren=92t working after = launching the debian guest - which also means I can=92t launch any more = guests.=20 root@borg:~ # xl list xc: error: Could not bounce buffer for version hypercall (35 =3D = Resource temporarily unavailabl): Internal error xc: error: Could not bounce buffer for version hypercall (35 =3D = Resource temporarily unavailabl): Internal error xc: error: Could not bounce buffer for version hypercall (35 =3D = Resource temporarily unavailabl): Internal error xc: error: Could not bounce buffer for version hypercall (35 =3D = Resource temporarily unavailabl): Internal error xc: error: Could not bounce buffer for version hypercall (35 =3D = Resource temporarily unavailabl): Internal error xc: error: Could not bounce buffer for version hypercall (35 =3D = Resource temporarily unavailabl): Internal error libxl: error: libxl.c:658:libxl_list_domain: getting domain info = list: Resource temporarily unavailable libxl_list_domain failed. I=92m heading out for the afternoon shortly, but it seems the next thing = to do is to get the consoles working correctly so I can get debugging = info from the hypervisor. Will hopefully bang on this this evening.=20 - David P. Discher http://davidpdischer.com/ AIM: DavidDPD | Y!M: daviddpdz=20 Mobile: 408.368.3725 On Dec 4, 2014, at 12:26 PM, David P. Discher wrote: > Yes, ICH10. I=92m not sure if an idle Dom0 does this, however limited = access to the disks, even just editing things like /boot/loader.conf and = /etc/rc.conf will eventually hang. But I=92m also trying to launch a = DomU, and for the convince of a documented process, I=92m following your = debian steps =85 and the debian installer is running. I=92m running a = zpool mirror across 4k aligned GPT partitions for the root drive. I=92ll = also attempt to break break the mirror, as I don=92t remember this being = a problem with a single drive.=20 >=20 > As first step last night, I actually moved the msi interrupts to =3D = 2, instead of fully disabled. And this helped a little. It seemed to = allow the AHCI driver to recovered after the first several timeouts. I = will try disabling MSI as well and well as iommu debug. However, I=92m = still without a Xen console. Durning the ACPI/pci probing =85 my console = over SOL com3 cuts out. I haven=92t try to recover it yet. I will see = what I can do. However, from what it looks like, Xen kernel is latching = on the com port, and freebsd sees it as =93busy=94. I=92ll see what I = can figure out. I believe the pm_level is default to 0, but will double = check that. >=20 --Apple-Mail=_ED4F376F-2810-47D9-BE3A-9BF54115C362 Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP using GPGMail -----BEGIN PGP SIGNATURE----- Comment: GPGTools - https://gpgtools.org iQEcBAEBCgAGBQJUgNHsAAoJEEmwU6XuhYWOeioIAKWQLcM9wZ65BgbEiuAWMOaj QThJgJyq2RCig04CPjCcg2zzQvqHkgWNEXqFXTnq7f5/PCbYEY1hBW3/Wmh3dxFw 39haGw4+5M5F9UGFgv96mPhyIrfnYwviJ8bd7+yZXjWvK6lpBWxkQi6EvAvSVe2Y z99RuVMWfGCWxavIjjJz6oyny3eQhUoyB7xjjKapeJOsyjQLx2RfvICm25zY93I1 fXK+fsCCrxJkTkFE4VW/zT6hmig3Ejj3xFLbylpHyNhl+lCZSfTvrXn7gBg7ta0N vaKZzPa6p2QzsXBe+vgnObkBt1gYmkZDCOKPsiF/UXd5qtlztJBM3LuzFwqWc74= =Sgjj -----END PGP SIGNATURE----- --Apple-Mail=_ED4F376F-2810-47D9-BE3A-9BF54115C362--