From owner-freebsd-xen@freebsd.org Sat Oct 12 09:59:17 2019 Return-Path: Delivered-To: freebsd-xen@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8723A1511D0 for ; Sat, 12 Oct 2019 09:59:17 +0000 (UTC) (envelope-from roger.pau@citrix.com) Received: from esa5.hc3370-68.iphmx.com (esa5.hc3370-68.iphmx.com [216.71.155.168]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "esa5.hc3370-68.iphmx.com", Issuer "HydrantID SSL ICA G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 46r0fD45Rwz3KRr for ; Sat, 12 Oct 2019 09:59:16 +0000 (UTC) (envelope-from roger.pau@citrix.com) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=citrix.com; s=securemail; t=1570874356; h=date:from:to:cc:subject:message-id:references: mime-version:in-reply-to; bh=UFc+7YPHpd1zxAhgZeQeFX4GE5UfJKgjapHlim/ifs0=; b=dXfgK71lcgxabKENd/JMvt5gB/Jgy7WlnxNT6qA4gvqNefUHLuVkk/c1 LdMxSrSCufsK0JNbaePYQfzG8oLrT3Nshg19Xp6fX07sZSEcpu6qUNRKg S91IYRPLG5EU6DCFvGW4nzZw2dJPJA00QpEEQn2QpV4nTfSMjZG6jJrf+ I=; Received-SPF: None (esa5.hc3370-68.iphmx.com: no sender authenticity information available from domain of roger.pau@citrix.com) identity=pra; client-ip=162.221.158.21; receiver=esa5.hc3370-68.iphmx.com; envelope-from="roger.pau@citrix.com"; x-sender="roger.pau@citrix.com"; x-conformance=sidf_compatible Received-SPF: Pass (esa5.hc3370-68.iphmx.com: domain of roger.pau@citrix.com designates 162.221.158.21 as permitted sender) identity=mailfrom; client-ip=162.221.158.21; receiver=esa5.hc3370-68.iphmx.com; envelope-from="roger.pau@citrix.com"; x-sender="roger.pau@citrix.com"; x-conformance=sidf_compatible; x-record-type="v=spf1"; x-record-text="v=spf1 ip4:209.167.231.154 ip4:178.63.86.133 ip4:195.66.111.40/30 ip4:85.115.9.32/28 ip4:199.102.83.4 ip4:192.28.146.160 ip4:192.28.146.107 ip4:216.52.6.88 ip4:216.52.6.188 ip4:162.221.158.21 ip4:162.221.156.83 ip4:168.245.78.127 ~all" Received-SPF: None (esa5.hc3370-68.iphmx.com: no sender authenticity information available from domain of postmaster@mail.citrix.com) identity=helo; client-ip=162.221.158.21; receiver=esa5.hc3370-68.iphmx.com; envelope-from="roger.pau@citrix.com"; x-sender="postmaster@mail.citrix.com"; x-conformance=sidf_compatible IronPort-SDR: yNrHCn9zfrwenx56CAZ7Ox9u44yPnnazC5zBTpXoaYCaqnSJICcPPyQtJ3RRCVTsf/cfaKs6vv n+CgVhgC35rW6u78fLLlrnUb9LLugTA/5PbeFKW/lEuYL2zt7H3c+HctJwrnuNKxtJaaDEgqI/ ZDgLqtegj6OHo321POYueB5VH1IDyhuOLo3TgDPUcbvnQwooeCFqFAueQzX+EpMTr56AVkZTrk 5j/YQSvs1yP3f4OEglMdxNYFkQojMo/27+yy/vVCQB6Gm30teKHuhado3VIWU3HhrHHDxw2FBE Ek8= X-SBRS: 2.7 X-MesageID: 7074688 X-Ironport-Server: esa5.hc3370-68.iphmx.com X-Remote-IP: 162.221.158.21 X-Policy: $RELAYED X-IronPort-AV: E=Sophos;i="5.67,287,1566878400"; d="scan'208";a="7074688" Date: Sat, 12 Oct 2019 11:59:00 +0200 From: Roger Pau =?iso-8859-1?Q?Monn=E9?= To: Brian Buhrow CC: Subject: Re: i/o is very slow on FreeBSD dom0 with Xen-4.12 and Freebsd-12 Message-ID: <20191012095900.GA14005@Air-de-Roger> References: <201910112153.x9BLrQSI028763@lothlorien.nfbcal.org> <201910112322.x9BNMWlp020596@lothlorien.nfbcal.org> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Disposition: inline In-Reply-To: <201910112322.x9BNMWlp020596@lothlorien.nfbcal.org> User-Agent: Mutt/1.12.2 (2019-09-21) X-ClientProxiedBy: AMSPEX02CAS01.citrite.net (10.69.22.112) To AMSPEX02CL02.citrite.net (10.69.22.126) X-Rspamd-Queue-Id: 46r0fD45Rwz3KRr X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=citrix.com header.s=securemail header.b=dXfgK71l; dmarc=pass (policy=none) header.from=citrix.com; spf=pass (mx1.freebsd.org: domain of roger.pau@citrix.com designates 216.71.155.168 as permitted sender) smtp.mailfrom=roger.pau@citrix.com X-Spamd-Result: default: False [-6.00 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[citrix.com:s=securemail]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; RCVD_DKIM_ARC_DNSWL_MED(-0.50)[]; DWL_DNSWL_LOW(-1.00)[citrix.com.dwl.dnswl.org : 127.0.9.1]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_MED(-0.20)[168.155.71.216.list.dnswl.org : 127.0.3.2]; DKIM_TRACE(0.00)[citrix.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[citrix.com,none]; RCVD_COUNT_ZERO(0.00)[0]; FROM_EQ_ENVFROM(0.00)[]; MID_RHS_NOT_FQDN(0.50)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:16417, ipnet:216.71.154.0/23, country:US]; IP_SCORE(-1.80)[ip: (-5.06), ipnet: 216.71.154.0/23(-2.60), asn: 16417(-1.27), country: US(-0.05)] X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 12 Oct 2019 09:59:17 -0000 On Fri, Oct 11, 2019 at 04:22:32PM -0700, Brian Buhrow wrote: > hello. Following up on this issue yet again, I'm pretty sure I have > the hardware discussed in the link below. I tried disabling interrupt > remapping as the article suggests, but that just makes matters worse. As I > understand it, when FreeBSD is running as a dom0, it must have iommu > interrupt remapping enabled in order to function. PVH dom0 requires iommu DMA remapping. Interrupt remapping is not mandated for PVH dom0. Can you also post the log when booting with iommu=verbose,debug,no-intremap? Can you also try booting without the no-intremap option, and then switch to the hypervisor console (Ctrl-A on the serial line) and paste the output of the i the M and the z debug keys at the point where FreeBSD freezes? (together with the full serial log) > Should I conclude that > this hardware just cannot run FreeBSD as a dom0 or is there another work > around that I might use? I need to look deeper, I'm quite sure the issue is with Xen. There are also some bugfixes for the iommu in Xen unstable, which I can try to backport to the FreeBSD 4.12.1 Xen packages, albeit there have been a lot of changes in the iommu code, so backporting might not be feasible for some of them. I'm leaving home today and will be on PTO until Tuesday, and I don't expect to be able to look into this until then, sorry. Thanks, Roger.