From owner-freebsd-xen@FreeBSD.ORG Sun Dec 14 23:34:05 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id A03E296A for ; Sun, 14 Dec 2014 23:34:05 +0000 (UTC) Received: from mail-pa0-x22b.google.com (mail-pa0-x22b.google.com [IPv6:2607:f8b0:400e:c03::22b]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 5EB2EFC1 for ; Sun, 14 Dec 2014 23:34:05 +0000 (UTC) Received: by mail-pa0-f43.google.com with SMTP id kx10so10672113pab.2 for ; Sun, 14 Dec 2014 15:34:04 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=dpdtech.com; s=google; h=content-type:mime-version:subject:from:in-reply-to:date:cc :message-id:references:to; bh=BKB9pHSLgThTid6XeA9VWi8aaEBQ2ZQsSnhr7hW1d+U=; b=QH2HjJrn4ZpOWRldV2Bqxyo4uBbwlOBwfQR2fcghRjfd324m6A+17XQuNqEGrkxWsl QZwW7TAMrAdDRubDOSQgMXVDcDn4oQm5P8xVBgKI89ZZsdpjB6j96c1ixDthlsJZZfAM Qbdu5nSpvLMDo7363pzbYyLxalGo1KjjraCQk= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:content-type:mime-version:subject:from :in-reply-to:date:cc:message-id:references:to; bh=BKB9pHSLgThTid6XeA9VWi8aaEBQ2ZQsSnhr7hW1d+U=; b=M8w1WV1luXTey8BEF/Y2e5lUXmZ3h9t0whhvJASdR4u7pCY0NEd07+yyRTW0yPjtRN 95+npvDfcQ/sS070rf1cBZOz2n1P8FFQ9AE7uBvL3OPo70en52rZFkRvciUScWW7Tl5x YVNdbhllwSgBr1/VJOI1dVyCLGsRDgopJtpl5jLHe7nbgFqqMfAr/6qjFOo50QVcl/GE 0Tv5EAC90TFdZ5dSfvx1KSdhbHD+Yz7ee/fVvDdzURVJ8sVCv0WyAG/ZHbplutdDIssG 7WLiBbW1NGFsgCY7Ww8fMPVxLNmfisk3LevN0O/0/QpKYTDEKJYvylzOmzXpQblzosnb /YAg== X-Gm-Message-State: ALoCoQlSWlqFUrdVSpS2eCegOJRlmLSXLN04WW41PEJqyc3+hZ75ufNTJnpfsNg0iTkif2ISd8pr X-Received: by 10.68.221.162 with SMTP id qf2mr46439640pbc.148.1418600044584; Sun, 14 Dec 2014 15:34:04 -0800 (PST) Received: from 173-13-188-41-sfba.hfc.comcastbusiness.net (173-13-188-41-sfba.hfc.comcastbusiness.net. [173.13.188.41]) by mx.google.com with ESMTPSA id tr8sm7389421pbc.30.2014.12.14.15.34.03 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Sun, 14 Dec 2014 15:34:03 -0800 (PST) Content-Type: multipart/signed; boundary="Apple-Mail=_346844B5-152E-47ED-BCC3-914B8EB83C46"; protocol="application/pgp-signature"; micalg=pgp-sha512 Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.6\)) Subject: Re: Attempting to Get Xen FreeBSD Dom0 working From: "David P. Discher" In-Reply-To: Date: Sun, 14 Dec 2014 15:34:08 -0800 Message-Id: References: <481F7D02-BFE9-4E35-A475-5A8A05A801CE@dpdtech.com> <547DFCC0.6030003@citrix.com> <547F1476.8080305@citrix.com> <29437DB9-7DC8-47A8-8FC4-2BFDE736B5BC@dpdtech.com> <547F59B4.1010105@citrix.com> <2DDCAA68-3B11-4E3C-AE61-EAD8CEEF1E2D@dpdtech.com> <547F6AC1.9060709@citrix.com> <7C356027-01D8-4800-B211-282566BC9871@dpdtech.com> <54801F77.5050700@citrix.com> <54819D6A.4050603@citrix.com> <7F90454D-16D5-4871-A155-5ADD01014976@dpdtech.com> <5486B287.7070302@citrix.com> <55E2C419-E537-4324-B7AB-A21E94863E17@dpdtech.com> To: Miguel Clara X-Mailer: Apple Mail (2.1878.6) Cc: freebsd-xen@freebsd.org X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 14 Dec 2014 23:34:05 -0000 --Apple-Mail=_346844B5-152E-47ED-BCC3-914B8EB83C46 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 First make sure you CPU supports both EPT and has a IOMMU. It sounds like you have Xen to use the serial console.=20 To /etc/ttys, you need to add: xc0 "/usr/libexec/getty Pc" vt100 on secure Also, make sure all the ttyu[0-4] are off. Recent versions of FreeBSD = maybe putting onifconsole =E2=80=A6 and I can't remember all the = combinations I used, but I had a lot of issues with Xen and FreeBSD = fighting for the serial ports. Also, make sure /boot/loader.conf is configured for = console=3D=E2=80=9Cvidconsole" on the freebsd side, and that the = xen_cmdline should have =E2=80=9Cconsole=3Dvga=E2=80=9D and not =3Dcom1. = It=E2=80=99s not explicit, but the Xen kernel creates the = =E2=80=9Cconsole=E2=80=9D. The xc0 device (and Xen itself) seems to take = care of piping the Dom0 console over to whatever Xen is using as = console.=20 Other tips, if you are running ZFS, you will probably need to add = "vm.max_wired=3D-1=E2=80=9D to /etc/sysctl.conf (I=E2=80=99m actually = not sure this is valid, but if you don=E2=80=99t you=E2=80=99ll run out = of wired memory and all the =E2=80=9Cxl=E2=80=9D commands will fail. Or = limit the size of ARC. ) You might need to turn off MSI interrupts on AHCI, "hint.ahci.0.msi=3D0=E2= =80=9D in /boot/loader.conf. However, try both ways (default I believe = is =3D1). I=E2=80=99m running Intel ICH10 and have to disable MSI. = Roger has ICH8 and doesn=E2=80=99t seem to have the issue. The latest issue is very poor network performance (with Intel 82574L) = from the DomU (guests) over the bridge and to the network. However, = Guests -> Dom0 seem ok.=20 - David P. Discher http://davidpdischer.com/ AIM: DavidDPD | Y!M: daviddpdz=20 On Dec 13, 2014, at 10:51 PM, Miguel Clara = wrote: > I was just trying too boot Freebsd Xen dom0 on a laptop but I just = get a black screen after the boot process.... >=20 > any idea what it could be? >=20 > the system boots fine wihtout loading "boot/xen", I'm not sure how to = get more info with the black scren! >=20 > thanks >=20 >=20 > Melhores Cumprimentos // Best Regards > ----------------------------------------------- > Miguel Clara > IT - Sys Admin & Developer > E-mail: miguelmclara@gmail.com > www.linkedin.com/in/miguelmclara/ >=20 > On Tue, Dec 9, 2014 at 7:17 PM, David P. Discher = wrote: > ah, sorry missed that. Will try that today. >=20 > AHCI lasted over night with MSI off. Something I noticed, is that = when the AHCI bus was timing out, it looked like the Xen Kernel was = re-scanning the PCI bus. (Sorry, didn=E2=80=99t save these logs). = I=E2=80=99ve love to dig into this further. >=20 > Please let me know what/where to add some debugging code. >=20 > - > David P. Discher > http://davidpdischer.com/ > AIM: DavidDPD | Y!M: daviddpdz > Mobile: 408.368.3725 >=20 >=20 >=20 > On Dec 9, 2014, at 12:27 AM, Roger Pau Monn=C3=A9 = wrote: >=20 > > Hello, > > > > El 08/12/14 a les 23.45, David P. Discher ha escrit: > > > >> > >> Sent SIGTERM to all processes = =E2=94=82 > >> Sent SIGKILL to all = processes=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2= =94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94= =80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80= =E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2= =94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94= =80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=98 > >> Requesting system reboot > >> [ 1157.299205] Restarting system. > >> root@borg:/zdata/debian # > >> root@borg:/zdata/debian # > >> root@borg:/zdata/debian # xl create -c debian.cfg > >> root@borg:/zdata/debian # xl destroy debian > >> xc: error: Could not bounce buffer for version hypercall (35 =3D= Resource temporarily unavailabl): Internal error > >> xc: error: Could not bounce buffer for version hypercall (35 =3D= Resource temporarily unavailabl): Internal error > >> xc: error: Could not bounce buffer for version hypercall (35 =3D= Resource temporarily unavailabl): Internal error > >> xc: error: Could not bounce buffer for version hypercall (35 =3D= Resource temporarily unavailabl): Internal error > >> xc: error: Could not bounce buffer for version hypercall (35 =3D= Resource temporarily unavailabl): Internal error > >> xc: error: Could not bounce buffer for version hypercall (35 =3D= Resource temporarily unavailabl): Internal error > >> libxl: error: libxl.c:658:libxl_list_domain: getting domain = info list: Resource temporarily unavailable > >> debian is an invalid domain identifier (rc=3D-5) > >> root@borg:/zdata/debian # > >> > >> I=E2=80=99m running AHCI with MSI off in the FreeBSD kernel, and so = far, so good on that front. The great thing is now I got the Xen = console working, so can get the debug output. However the bounce = buffer/hypercall issue i would think is far more important than MSI = interrupts at the monument. > > > > Glad to know you got it working at the end! I've already pointed = this > > out in my last email, but did you try to increase vm.max_wired even = further? > > > > This usually happens when mlock in > > freebsd_privcmd_alloc_hypercall_buffer (xc_freebsd_osdep.c) fails to > > wire down the memory that would be used by the hypercalls. > > > > Roger. > > >=20 --Apple-Mail=_346844B5-152E-47ED-BCC3-914B8EB83C46 Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP using GPGMail -----BEGIN PGP SIGNATURE----- Comment: GPGTools - https://gpgtools.org iQEcBAEBCgAGBQJUjh5xAAoJEEmwU6XuhYWOfb8IAK3lYNpE3bOHBlklrlse5K9l 9s7NH0kLclP/ka0WZB4+ZKAu15dB4Ci4IPFbIw0oolqRjb05dcOg95ImJ0JR6MiO roI7x1XAplrKbhm75GLfwst5xW76HDuxh1Toyi8l0n+7Zhi8zFkff1twhWe7aIuo Iq9Ci8+z3Yvw4IcVpx9P3lcP62By4/Me6/WvOJ+WKF/Rqrvuwag9XVx4SL3STMVj QBZPwppFWWAKLQI58yX5fPk+if9GLjvAyCBHn1CdbRCTB+ZYw7PVgxhnIIB1/jv1 GHfAxHlzQoNYBex/NPEYd/wfZ7Q/zhSKIEiULo0x9RTjB+4tkxdZOrby59ya1Jo= =jHBQ -----END PGP SIGNATURE----- --Apple-Mail=_346844B5-152E-47ED-BCC3-914B8EB83C46--