From owner-freebsd-xen@freebsd.org Mon Oct 14 21:45:18 2019 Return-Path: Delivered-To: freebsd-xen@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 991351410F4 for ; Mon, 14 Oct 2019 21:45:18 +0000 (UTC) (envelope-from buhrow@lothlorien.nfbcal.org) Received: from lothlorien.nfbcal.org (ns.NFBCAL.ORG [157.22.230.125]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "nfbcal.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 46sXCx0NnLz3xJJ; Mon, 14 Oct 2019 21:45:16 +0000 (UTC) (envelope-from buhrow@lothlorien.nfbcal.org) Received: from lothlorien.nfbcal.org (localhost [127.0.0.1]) by lothlorien.nfbcal.org (8.15.2/8.14.1-NFBNETBSD) with ESMTPS id x9ELj4Pr011527 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Mon, 14 Oct 2019 14:45:06 -0700 (PDT) X-Virus-Status: Clean X-Virus-Scanned: clamav-milter 0.97.3 at lothlorien.nfbcal.org Received: (from buhrow@localhost) by lothlorien.nfbcal.org (8.15.2/8.12.11) id x9ELj4c8008732; Mon, 14 Oct 2019 14:45:04 -0700 (PDT) Message-Id: <201910142145.x9ELj4c8008732@lothlorien.nfbcal.org> From: Brian Buhrow Date: Mon, 14 Oct 2019 14:45:04 -0700 In-Reply-To: X-Mailer: Mail User's Shell (7.2.6 beta(4.pl1)+dynamic 20000103) To: =?UTF-8?Q?Roger_Pau_Monn=C3=A9?= Subject: Re: i/o is very slow on FreeBSD dom0 with Xen-4.12 and Freebsd-12 Cc: Roger Pau Monne , freebsd-xen@freebsd.org, buhrow@nfbcal.org X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.4.3 (lothlorien.nfbcal.org [127.0.0.1]); Mon, 14 Oct 2019 14:45:06 -0700 (PDT) X-Rspamd-Queue-Id: 46sXCx0NnLz3xJJ X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of buhrow@lothlorien.nfbcal.org designates 157.22.230.125 as permitted sender) smtp.mailfrom=buhrow@lothlorien.nfbcal.org X-Spamd-Result: default: False [-2.06 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.96)[-0.958,0]; RCPT_COUNT_THREE(0.00)[4]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+a:ns.nfbcal.org]; FROM_HAS_DN(0.00)[]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[nfbcal.org]; NEURAL_HAM_LONG(-0.99)[-0.987,0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; IP_SCORE(-0.12)[ipnet: 157.22.0.0/16(-0.30), asn: 7091(-0.24), country: US(-0.05)]; FORGED_SENDER(0.30)[buhrow@nfbcal.org,buhrow@lothlorien.nfbcal.org]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:7091, ipnet:157.22.0.0/16, country:US]; FROM_NEQ_ENVFROM(0.00)[buhrow@nfbcal.org,buhrow@lothlorien.nfbcal.org]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 Oct 2019 21:45:18 -0000 hello. Using: ioapic_ack=old causes the dom0 to crash. Below are the logs. -thanks -Brian boot_serial="YES" # -h: Use serial console comconsole_speed="115200" # Set the current serial console speed comconsole_port="0x2f8" # Set the current serial console port #console="vidconsole" # A comma separated list of console(s) console="comconsole" # A comma separated list of console(s) geom_mirror_load="YES" # RAID1 disk driver (see gmirror(8)) ahci_load="YES" # ahci driver ipmi_load="YES" # Ripmi driver if_tap_load="YES" # Load bridge driver. if_vlan_load="YES" # Load vlan driver. # Turn on Xen (BB 10/08/2019) xen_kernel="/boot/xen" xen_cmdline="dom0_mem=4096m dom0_max_vcpus=4 dom0=pvh,verbose console=com2,vga ioapic_ack=old iommu=verbose,debug sync_console=true com2=115200,8n1 guest_loglvl=all loglvl=all" (XEN) Xen version 4.12.1 (buhrow@) (FreeBSD clang version 6.0.1 (tags/RELEASE_601/final 335540) (based on LLVM 6.0.1)) debug=n Thu Oct 3 11:34:20 PDT 2019 (XEN) Latest ChangeSet: (XEN) Console output is synchronous. (XEN) Bootloader: FreeBSD Loader (XEN) Command line: dom0_mem=4096m dom0_max_vcpus=4 dom0=pvh,verbose console=com2,vga ioapic_ack=old iommu=verbose,debug sync_console=true com2=115200,8n1 guest_loglvl=all loglvl=all (XEN) Xen image load base address: 0 (XEN) Video information: (XEN) VGA is text mode 80x25, font 8x16 (XEN) VBE/DDC methods: none; EDID transfer time: 0 seconds (XEN) EDID info not retrieved because no DDC retrieval method detected (XEN) Disc information: (XEN) Found 4 MBR signatures (XEN) Found 4 EDD information structures (XEN) Xen-e820 RAM map: (XEN) 0000000000000000 - 0000000000098400 (usable) (XEN) 0000000000098400 - 00000000000a0000 (reserved) (XEN) 00000000000e0000 - 0000000000100000 (reserved) (XEN) 0000000000100000 - 00000000bf780000 (usable) (XEN) 00000000bf78e000 - 00000000bf790000 type 9 (XEN) 00000000bf790000 - 00000000bf79e000 (ACPI data) (XEN) 00000000bf79e000 - 00000000bf7d0000 (ACPI NVS) (XEN) 00000000bf7d0000 - 00000000bf7e0000 (reserved) (XEN) 00000000bf7ec000 - 00000000c0000000 (reserved) (XEN) 00000000e0000000 - 00000000f0000000 (reserved) (XEN) 00000000fee00000 - 00000000fee01000 (reserved) (XEN) 00000000ffc00000 - 0000000100000000 (reserved) (XEN) 0000000100000000 - 0000001840000000 (usable) (XEN) New Xen image base address: 0xbf000000 (XEN) ACPI: RSDP 000FACE0, 0024 (r2 ACPIAM) (XEN) ACPI: XSDT BF790100, 008C (r1 SMCI 20120803 MSFT 97) (XEN) ACPI: FACP BF790290, 00F4 (r3 080312 FACP1521 20120803 MSFT 97) (XEN) ACPI: DSDT BF7906A0, 6580 (r1 10600 10600000 0 INTL 20051117) (XEN) ACPI: FACS BF79E000, 0040 (XEN) ACPI: APIC BF790390, 011E (r1 080312 APIC1521 20120803 MSFT 97) (XEN) ACPI: MCFG BF7904B0, 003C (r1 080312 OEMMCFG 20120803 MSFT 97) (XEN) ACPI: SLIT BF7904F0, 0030 (r1 080312 OEMSLIT 20120803 MSFT 97) (XEN) ACPI: OEMB BF79E040, 0086 (r1 080312 OEMB1521 20120803 MSFT 97) (XEN) ACPI: SRAT BF79A6A0, 01D0 (r1 080312 OEMSRAT 1 INTL 1) (XEN) ACPI: HPET BF79A870, 0038 (r1 080312 OEMHPET 20120803 MSFT 97) (XEN) ACPI: DMAR BF79E0D0, 0130 (r1 AMI OEMDMAR 1 MSFT 97) (XEN) ACPI: SSDT BF7A1710, 0363 (r1 DpgPmm CpuPm 12 INTL 20051117) (XEN) ACPI: EINJ BF79A8B0, 0130 (r1 AMIER AMI_EINJ 20120803 MSFT 97) (XEN) ACPI: BERT BF79AA40, 0030 (r1 AMIER AMI_BERT 20120803 MSFT 97) (XEN) ACPI: ERST BF79AA70, 01B0 (r1 AMIER AMI_ERST 20120803 MSFT 97) (XEN) ACPI: HEST BF79AC20, 00A8 (r1 AMIER ABC_HEST 20120803 MSFT 97) (XEN) System RAM: 98295MB (100654176kB) (XEN) SRAT: PXM 0 -> APIC 00 -> Node 0 (XEN) SRAT: PXM 0 -> APIC 02 -> Node 0 (XEN) SRAT: PXM 0 -> APIC 04 -> Node 0 (XEN) SRAT: PXM 0 -> APIC 06 -> Node 0 (XEN) SRAT: PXM 0 -> APIC 01 -> Node 0 (XEN) SRAT: PXM 0 -> APIC 03 -> Node 0 (XEN) SRAT: PXM 0 -> APIC 05 -> Node 0 (XEN) SRAT: PXM 0 -> APIC 07 -> Node 0 (XEN) SRAT: PXM 1 -> APIC 10 -> Node 1 (XEN) SRAT: PXM 1 -> APIC 12 -> Node 1 (XEN) SRAT: PXM 1 -> APIC 14 -> Node 1 (XEN) SRAT: PXM 1 -> APIC 16 -> Node 1 (XEN) SRAT: PXM 1 -> APIC 11 -> Node 1 (XEN) SRAT: PXM 1 -> APIC 13 -> Node 1 (XEN) SRAT: PXM 1 -> APIC 15 -> Node 1 (XEN) SRAT: PXM 1 -> APIC 17 -> Node 1 (XEN) SRAT: Node 0 PXM 0 0-a0000 (XEN) SRAT: Node 0 PXM 0 100000-c0000000 (XEN) SRAT: Node 0 PXM 0 100000000-c40000000 (XEN) SRAT: Node 1 PXM 1 c40000000-1840000000 (XEN) NUMA: Allocated memnodemap from 183e1b7000 - 183e1d0000 (XEN) NUMA: Using 8 for the hash shift. (XEN) Domain heap initialised DMA width 32 bits (XEN) CPU Vendor: Intel, Family 6 (0x6), Model 26 (0x1a), Stepping 5 (raw 000106a5) (XEN) found SMP MP-table at 000ff780 (XEN) DMI present. (XEN) Using APIC driver default (XEN) ACPI: PM-Timer IO Port: 0x808 (32 bits) (XEN) ACPI: SLEEP INFO: pm1x_cnt[1:804,1:0], pm1x_evt[1:800,1:0] (XEN) ACPI: wakeup_vec[bf79e00c], vec_size[20] (XEN) ACPI: Local APIC address 0xfee00000 (XEN) ACPI: LAPIC (acpi_id[0x01] lapic_id[0x00] enabled) (XEN) ACPI: LAPIC (acpi_id[0x02] lapic_id[0x10] enabled) (XEN) ACPI: LAPIC (acpi_id[0x03] lapic_id[0x02] enabled) (XEN) ACPI: LAPIC (acpi_id[0x04] lapic_id[0x12] enabled) (XEN) ACPI: LAPIC (acpi_id[0x05] lapic_id[0x04] enabled) (XEN) ACPI: LAPIC (acpi_id[0x06] lapic_id[0x14] enabled) (XEN) ACPI: LAPIC (acpi_id[0x07] lapic_id[0x06] enabled) (XEN) ACPI: LAPIC (acpi_id[0x08] lapic_id[0x16] enabled) (XEN) ACPI: LAPIC (acpi_id[0x09] lapic_id[0x01] enabled) (XEN) ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x11] enabled) (XEN) ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x03] enabled) (XEN) ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x13] enabled) (XEN) ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x05] enabled) (XEN) ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x15] enabled) (XEN) ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x07] enabled) (XEN) ACPI: LAPIC (acpi_id[0x10] lapic_id[0x17] enabled) (XEN) ACPI: LAPIC (acpi_id[0x11] lapic_id[0x90] disabled) (XEN) ACPI: LAPIC (acpi_id[0x12] lapic_id[0x91] disabled) (XEN) ACPI: LAPIC (acpi_id[0x13] lapic_id[0x92] disabled) (XEN) ACPI: LAPIC (acpi_id[0x14] lapic_id[0x93] disabled) (XEN) ACPI: LAPIC (acpi_id[0x15] lapic_id[0x94] disabled) (XEN) ACPI: LAPIC (acpi_id[0x16] lapic_id[0x95] disabled) (XEN) ACPI: LAPIC (acpi_id[0x17] lapic_id[0x96] disabled) (XEN) ACPI: LAPIC (acpi_id[0x18] lapic_id[0x97] disabled) (XEN) ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) (XEN) Overriding APIC driver with bigsmp (XEN) ACPI: IOAPIC (id[0x08] address[0xfec00000] gsi_base[0]) (XEN) IOAPIC[0]: apic_id 8, version 32, address 0xfec00000, GSI 0-23 (XEN) ACPI: IOAPIC (id[0x09] address[0xfec8a000] gsi_base[24]) (XEN) IOAPIC[1]: apic_id 9, version 32, address 0xfec8a000, GSI 24-47 (XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) (XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) (XEN) ACPI: IRQ0 used by override. (XEN) ACPI: IRQ2 used by override. (XEN) ACPI: IRQ9 used by override. (XEN) Enabling APIC mode: Phys. Using 2 I/O APICs (XEN) ACPI: HPET id: 0x8086a301 base: 0xfed00000 (XEN) PCI: MCFG configuration 0: base e0000000 segment 0000 buses 00 - ff (XEN) PCI: MCFG area at e0000000 reserved in E820 (XEN) PCI: Using MCFG for segment 0000 bus 00-ff (XEN) [VT-D]Host address width 40 (XEN) [VT-D]found ACPI_DMAR_DRHD: (XEN) [VT-D] dmaru->address = fbffe000 (XEN) [VT-D]drhd->address = fbffe000 iommu->reg = ffff82c00021d000 (XEN) [VT-D]cap = c90780106f0462 ecap = f020fe (XEN) [VT-D] IOAPIC: 0000:f0:1f.7 (XEN) [VT-D] IOAPIC: 0000:00:13.0 (XEN) [VT-D] flags: INCLUDE_ALL (XEN) [VT-D]found ACPI_DMAR_RMRR: (XEN) [VT-D] endpoint: 0000:00:1d.0 (XEN) [VT-D] endpoint: 0000:00:1d.1 (XEN) [VT-D] endpoint: 0000:00:1d.2 (XEN) [VT-D] endpoint: 0000:00:1d.7 (XEN) [VT-D] endpoint: 0000:00:1a.0 (XEN) [VT-D] endpoint: 0000:00:1a.1 (XEN) [VT-D] endpoint: 0000:00:1a.2 (XEN) [VT-D] endpoint: 0000:00:1a.7 (XEN) [VT-D]found ACPI_DMAR_RMRR: (XEN) [VT-D] endpoint: 0000:00:1d.0 (XEN) [VT-D] endpoint: 0000:00:1d.1 (XEN) [VT-D] endpoint: 0000:00:1d.2 (XEN) [VT-D] endpoint: 0000:00:1d.7 (XEN) [VT-D] endpoint: 0000:00:1a.0 (XEN) [VT-D] endpoint: 0000:00:1a.1 (XEN) [VT-D] endpoint: 0000:00:1a.2 (XEN) [VT-D] endpoint: 0000:00:1a.7 (XEN) [VT-D]found ACPI_DMAR_ATSR: (XEN) [VT-D] atsru->all_ports: 0 (XEN) [VT-D] bridge: 0000:00:01.0 start=0 sec=1 sub=1 (XEN) [VT-D] bridge: 0000:00:03.0 start=0 sec=2 sub=2 (XEN) [VT-D] bridge: 0000:00:05.0 start=0 sec=3 sub=3 (XEN) [VT-D] bridge: 0000:00:07.0 start=0 sec=4 sub=4 (XEN) [VT-D] bridge: 0000:00:09.0 start=0 sec=5 sub=5 (XEN) Failed to get Error Log Address Range. (XEN) HEST: Table parsing has been initialized (XEN) Using ACPI (MADT) for SMP configuration information (XEN) SMP: Allowing 24 CPUs (8 hotplug CPUs) (XEN) IRQ limits: 48 GSI, 3040 MSI/MSI-X (XEN) CPU0: Intel machine check reporting enabled (XEN) Speculative mitigation facilities: (XEN) Hardware features: (XEN) Compiled-in support: SHADOW_PAGING (XEN) Xen settings: BTI-Thunk N/A, SPEC_CTRL: No, Other: (XEN) L1TF: believed vulnerable, maxphysaddr L1D 44, CPUID 40, Safe address 10000000000 (XEN) Support for HVM VMs: RSB EAGER_FPU (XEN) Support for PV VMs: RSB EAGER_FPU (XEN) XPTI (64-bit PV only): Dom0 enabled, DomU enabled (without PCID) (XEN) PV L1TF shadowing: Dom0 disabled, DomU enabled (XEN) Using scheduler: SMP Credit Scheduler rev2 (credit2) (XEN) Initializing Credit2 scheduler (XEN) load_precision_shift: 18 (XEN) load_window_shift: 30 (XEN) underload_balance_tolerance: 0 (XEN) overload_balance_tolerance: -3 (XEN) runqueues arrangement: socket (XEN) cap enforcement granularity: 10ms (XEN) load tracking window length 1073741824 ns (XEN) Adding cpu 0 to runqueue 0 (XEN) First cpu on runqueue, activating (XEN) Platform timer is 14.318MHz HPET (XEN) Detected 2279.646 MHz processor. (XEN) Initing memory sharing. (XEN) alt table ffff82d0804309b8 -> ffff82d0804318d0 (XEN) Intel VT-d iommu 0 supported page sizes: 4kB. (XEN) Intel VT-d Snoop Control enabled. (XEN) Intel VT-d Dom0 DMA Passthrough not enabled. (XEN) Intel VT-d Queued Invalidation enabled. (XEN) Intel VT-d Interrupt Remapping enabled. (XEN) Intel VT-d Posted Interrupt not enabled. (XEN) Intel VT-d Shared EPT tables not enabled. (XEN) I/O virtualisation enabled (XEN) - Dom0 mode: Relaxed (XEN) Interrupt remapping enabled (XEN) nr_sockets: 3 (XEN) ENABLING IO-APIC IRQs (XEN) -> Using old ACK method (XEN) ..TIMER: vector=0xF0 apic1=0 pin1=2 apic2=-1 pin2=-1 (XEN) Allocated console ring of 128 KiB. (XEN) mwait-idle: MWAIT substates: 0x1120 (XEN) mwait-idle: v0.4.1 model 0x1a (XEN) mwait-idle: lapic_timer_reliable_states 0x2 (XEN) HPET: 0 timers usable for broadcast (4 total) (XEN) VMX: Supported advanced features: (XEN) - APIC MMIO access virtualisation (XEN) - APIC TPR shadow (XEN) - Extended Page Tables (EPT) (XEN) - Virtual-Processor Identifiers (VPID) (XEN) - Virtual NMI (XEN) - MSR direct-access bitmap (XEN) HVM: ASIDs enabled. (XEN) HVM: VMX enabled (XEN) HVM: Hardware Assisted Paging (HAP) detected (XEN) HVM: HAP page sizes: 4kB, 2MB (XEN) Adding cpu 1 to runqueue 0 (XEN) Adding cpu 2 to runqueue 0 (XEN) Adding cpu 3 to runqueue 0 (XEN) Adding cpu 4 to runqueue 0 (XEN) Adding cpu 5 to runqueue 0 (XEN) Adding cpu 6 to runqueue 0 (XEN) Adding cpu 7 to runqueue 0 (XEN) Adding cpu 8 to runqueue 1 (XEN) First cpu on runqueue, activating (XEN) Adding cpu 9 to runqueue 1 (XEN) Adding cpu 10 to runqueue 1 (XEN) Adding cpu 11 to runqueue 1 (XEN) Adding cpu 12 to runqueue 1 (XEN) Adding cpu 13 to runqueue 1 (XEN) Adding cpu 14 to runqueue 1 (XEN) Adding cpu 15 to runqueue 1 (XEN) Brought up 16 CPUs (XEN) build-id: aba2ec2f0b48776dac7a6e615962fec7240f6447 (XEN) ACPI sleep modes: S3 (XEN) VPMU: disabled (XEN) mcheck_poll: Machine check polling timer started. (XEN) Dom0 has maximum 816 PIRQs (XEN) NX (Execute Disable) protection active (XEN) *** Building a PVH Dom0 *** (XEN) [VT-D]d0:Hostbridge: skip 0000:00:00.0 map (XEN) Masked UR signaling on 0000:00:00.0 (XEN) Masked UR signaling on 0000:00:01.0 (XEN) Masked UR signaling on 0000:00:03.0 (XEN) Masked UR signaling on 0000:00:05.0 (XEN) Masked UR signaling on 0000:00:07.0 (XEN) Masked UR signaling on 0000:00:09.0 (XEN) [VT-D]d0:PCI: map 0000:00:13.0 (XEN) [VT-D]d0:PCIe: map 0000:00:14.0 (XEN) Masked VT-d error signaling on 0000:00:14.0 (XEN) [VT-D]d0:PCIe: map 0000:00:14.1 (XEN) [VT-D]d0:PCIe: map 0000:00:14.2 (XEN) [VT-D]d0:PCI: map 0000:00:14.3 (XEN) [VT-D]d0:PCIe: map 0000:00:16.0 (XEN) [VT-D]d0:PCIe: map 0000:00:16.1 (XEN) [VT-D]d0:PCIe: map 0000:00:16.2 (XEN) [VT-D]d0:PCIe: map 0000:00:16.3 (XEN) [VT-D]d0:PCIe: map 0000:00:16.4 (XEN) [VT-D]d0:PCIe: map 0000:00:16.5 (XEN) [VT-D]d0:PCIe: map 0000:00:16.6 (XEN) [VT-D]d0:PCIe: map 0000:00:16.7 (XEN) [VT-D]d0:PCI: map 0000:00:1a.0 (XEN) [VT-D]d0:PCI: map 0000:00:1a.1 (XEN) [VT-D]d0:PCI: map 0000:00:1a.2 (XEN) [VT-D]d0:PCI: map 0000:00:1a.7 (XEN) [VT-D]d0:PCI: map 0000:00:1d.0 (XEN) [VT-D]d0:PCI: map 0000:00:1d.1 (XEN) [VT-D]d0:PCI: map 0000:00:1d.2 (XEN) [VT-D]d0:PCI: map 0000:00:1d.7 (XEN) [VT-D]d0:PCI: map 0000:00:1f.0 (XEN) [VT-D]d0:PCI: map 0000:00:1f.2 (XEN) [VT-D]d0:PCI: map 0000:00:1f.3 (XEN) [VT-D]d0:PCIe: map 0000:01:00.0 (XEN) [VT-D]d0:PCIe: map 0000:01:00.1 (XEN) [VT-D]d0:PCIe: map 0000:03:00.0 (XEN) [VT-D]d0:PCIe: map 0000:03:00.1 (XEN) [VT-D]d0:PCI: map 0000:06:01.0 (XEN) [VT-D]d0:Hostbridge: skip 0000:fe:00.0 map (XEN) [VT-D]d0:Hostbridge: skip 0000:fe:00.1 map (XEN) [VT-D]d0:Hostbridge: skip 0000:fe:02.0 map (XEN) [VT-D]d0:Hostbridge: skip 0000:fe:02.1 map (XEN) [VT-D]d0:Hostbridge: skip 0000:fe:02.4 map (XEN) [VT-D]d0:Hostbridge: skip 0000:fe:02.5 map (XEN) [VT-D]d0:Hostbridge: skip 0000:fe:03.0 map (XEN) [VT-D]d0:Hostbridge: skip 0000:fe:03.1 map (XEN) [VT-D]d0:Hostbridge: skip 0000:fe:03.2 map (XEN) [VT-D]d0:Hostbridge: skip 0000:fe:03.4 map (XEN) [VT-D]d0:Hostbridge: skip 0000:fe:04.0 map (XEN) [VT-D]d0:Hostbridge: skip 0000:fe:04.1 map (XEN) [VT-D]d0:Hostbridge: skip 0000:fe:04.2 map (XEN) [VT-D]d0:Hostbridge: skip 0000:fe:04.3 map (XEN) [VT-D]d0:Hostbridge: skip 0000:fe:05.0 map (XEN) [VT-D]d0:Hostbridge: skip 0000:fe:05.1 map (XEN) [VT-D]d0:Hostbridge: skip 0000:fe:05.2 map (XEN) [VT-D]d0:Hostbridge: skip 0000:fe:05.3 map (XEN) [VT-D]d0:Hostbridge: skip 0000:fe:06.0 map (XEN) [VT-D]d0:Hostbridge: skip 0000:fe:06.1 map (XEN) [VT-D]d0:Hostbridge: skip 0000:fe:06.2 map (XEN) [VT-D]d0:Hostbridge: skip 0000:fe:06.3 map (XEN) [VT-D]d0:Hostbridge: skip 0000:ff:00.0 map (XEN) [VT-D]d0:Hostbridge: skip 0000:ff:00.1 map (XEN) [VT-D]d0:Hostbridge: skip 0000:ff:02.0 map (XEN) [VT-D]d0:Hostbridge: skip 0000:ff:02.1 map (XEN) [VT-D]d0:Hostbridge: skip 0000:ff:02.4 map (XEN) [VT-D]d0:Hostbridge: skip 0000:ff:02.5 map (XEN) [VT-D]d0:Hostbridge: skip 0000:ff:03.0 map (XEN) [VT-D]d0:Hostbridge: skip 0000:ff:03.1 map (XEN) [VT-D]d0:Hostbridge: skip 0000:ff:03.2 map (XEN) [VT-D]d0:Hostbridge: skip 0000:ff:03.4 map (XEN) [VT-D]d0:Hostbridge: skip 0000:ff:04.0 map (XEN) [VT-D]d0:Hostbridge: skip 0000:ff:04.1 map (XEN) [VT-D]d0:Hostbridge: skip 0000:ff:04.2 map (XEN) [VT-D]d0:Hostbridge: skip 0000:ff:04.3 map (XEN) [VT-D]d0:Hostbridge: skip 0000:ff:05.0 map (XEN) [VT-D]d0:Hostbridge: skip 0000:ff:05.1 map (XEN) [VT-D]d0:Hostbridge: skip 0000:ff:05.2 map (XEN) [VT-D]d0:Hostbridge: skip 0000:ff:05.3 map (XEN) [VT-D]d0:Hostbridge: skip 0000:ff:06.0 map (XEN) [VT-D]d0:Hostbridge: skip 0000:ff:06.1 map (XEN) [VT-D]d0:Hostbridge: skip 0000:ff:06.2 map (XEN) [VT-D]d0:Hostbridge: skip 0000:ff:06.3 map (XEN) [VT-D]iommu_enable_translation: iommu->reg = ffff82c00021d000 (XEN) Dom0 memory allocation stats: (XEN) order 3 allocations: 2 (XEN) order 4 allocations: 1 (XEN) order 5 allocations: 1 (XEN) order 6 allocations: 1 (XEN) order 7 allocations: 3 (XEN) order 8 allocations: 2 (XEN) order 9 allocations: 2 (XEN) order 10 allocations: 2 (XEN) order 11 allocations: 2 (XEN) order 12 allocations: 2 (XEN) order 13 allocations: 2 (XEN) order 14 allocations: 2 (XEN) order 15 allocations: 2 (XEN) order 16 allocations: 2 (XEN) order 17 allocations: 2 (XEN) order 18 allocations: 2 (XEN) WARNING: PVH is an experimental mode with limited functionality (XEN) Initial low memory virq threshold set at 0x4000 pages. (XEN) Scrubbing Free RAM in background (XEN) Std. Loglevel: All (XEN) Guest Loglevel: All (XEN) *************************************************** (XEN) WARNING: CONSOLE OUTPUT IS SYNCHRONOUS (XEN) This option is intended to aid debugging of Xen by ensuring (XEN) that all output is synchronously delivered on the serial line. (XEN) However it can introduce SIGNIFICANT latencies and affect (XEN) timekeeping. It is NOT recommended for production use! (XEN) *************************************************** (XEN) Booted on L1TF-vulnerable hardware with SMT/Hyperthreading (XEN) enabled. Please assess your configuration and choose an (XEN) explicit 'smt=' setting. See XSA-273. (XEN) *************************************************** (XEN) Booted on MLPDS/MFBDS-vulnerable hardware with SMT/Hyperthreading (XEN) enabled. Mitigations will not be fully effective. Please (XEN) choose an explicit smt= setting. See XSA-297. (XEN) *************************************************** (XEN) 3... 2... 1... (XEN) Xen is relinquishing VGA console. (XEN) *** Serial input to DOM0 (type 'CTRL-a' three times to switch input) (XEN) Freed 500kB init memory ---<>--- Copyright (c) 1992-2018 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 12.0-RELEASE-p10 GENERIC amd64 FreeBSD clang version 6.0.1 (tags/RELEASE_601/final 335540) (based on LLVM 6.0.1) VT(vga): text 80x25 XEN: Hypervisor version 4.12 detected. CPU: Intel(R) Xeon(R) CPU E5520 @ 2.27GHz (2279.65-MHz K8-class CPU) Origin="GenuineIntel" Id=0x106a5 Family=0x6 Model=0x1a Stepping=5 Features=0x1fc3fbff Features2=0x80982201 AMD Features=0x28100800 AMD Features2=0x1 TSC: P-state invariant Hypervisor: Origin = "XenVMMXenVMM" real memory = 5378048000 (5128 MB) avail memory = 4099301376 (3909 MB) Event timer "LAPIC" quality 100 ACPI APIC Table: <080312 APIC1521> FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs FreeBSD/SMP: 1 package(s) x 4 core(s) random: unblocking device. Firmware Warning (ACPI): 32/64X length mismatch in FADT/Gpe0Block: 128/64 (20181003/tbfadt-748) ioapic1: Changing APIC ID to 9 ioapic0 irqs 0-23 on motherboard ioapic1 irqs 24-24 on motherboard Launching APs: 2 1 3 random: entropy device external interface kbd1 at kbdmux0 netmap: loaded module [ath_hal] loaded module_register_init: MOD_LOAD (vesa, 0xffffffff810f9a00, 0) error 19 nexus0 vtvga0: on motherboard cryptosoft0: on motherboard acpi0: on motherboard (XEN) d0: bind: m_gsi=9 g_gsi=9 acpi0: Power Button (fixed) cpu0: on acpi0 attimer0: port 0x40-0x43 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 atrtc0: port 0x70-0x71 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s (XEN) d0: bind: m_gsi=8 g_gsi=8 Event timer "RTC" frequency 32768 Hz quality 0 hpet0: iomem 0xfed03000-0xfed033ff on acpi0 hpet0: HPET never increments, disabling device_attach: hpet0 attach returned 6 Timecounter "ACPI-safe" frequency 3579545 Hz quality 850 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 pcib1: at device 1.0 on pci0 pci1: on pcib1 igb0: port 0xdc00-0xdc1f mem 0xfbce0000-0xfbcfffff,0xfbcc0000-0xfbcdffff,0xfbc9c000-0xfbc9ffff irq 28 at device 0.0 on pci1 igb0: attach_pre capping queues at 8 igb0: using 1024 tx descriptors and 1024 rx descriptors igb0: msix_init qsets capped at 8 igb0: pxm cpus: 4 queue msgs: 9 admincnt: 1 igb0: using 4 rx queues 4 tx queues igb0: Using MSIX interrupts with 5 vectors igb0: allocated for 4 tx_queues igb0: allocated for 4 rx_queues igb0: Ethernet address: 00:25:90:36:fd:2e igb0: netmap queues/slots: TX 4/1024, RX 4/1024 igb1: port 0xd880-0xd89f mem 0xfbc60000-0xfbc7ffff,0xfbc40000-0xfbc5ffff,0xfbc1c000-0xfbc1ffff irq 40 at device 0.1 on pci1 igb1: attach_pre capping queues at 8 igb1: using 1024 tx descriptors and 1024 rx descriptors igb1: msix_init qsets capped at 8 igb1: pxm cpus: 4 queue msgs: 9 admincnt: 1 igb1: using 4 rx queues 4 tx queues igb1: Using MSIX interrupts with 5 vectors igb1: allocated for 4 tx_queues igb1: allocated for 4 rx_queues igb1: Ethernet address: 00:25:90:36:fd:2f igb1: netmap queues/slots: TX 4/1024, RX 4/1024 pcib2: at device 3.0 on pci0 pci2: on pcib2 pcib3: at device 5.0 on pci0 pci3: on pcib3 igb2: port 0xec00-0xec1f mem 0xfbde0000-0xfbdfffff,0xfbdc0000-0xfbddffff,0xfbd9c000-0xfbd9ffff irq 26 at device 0.0 on pci3 igb2: attach_pre capping queues at 8 igb2: using 1024 tx descriptors and 1024 rx descriptors igb2: msix_init qsets capped at 8 igb2: pxm cpus: 4 queue msgs: 9 admincnt: 1 igb2: using 4 rx queues 4 tx queues igb2: Using MSIX interrupts with 5 vectors igb2: allocated for 4 tx_queues igb2: allocated for 4 rx_queues igb2: Ethernet address: 00:25:90:09:c8:da igb2: netmap queues/slots: TX 4/1024, RX 4/1024 igb3: port 0xe880-0xe89f mem 0xfbd60000-0xfbd7ffff,0xfbd40000-0xfbd5ffff,0xfbd1c000-0xfbd1ffff irq 25 at device 0.1 on pci3 igb3: attach_pre capping queues at 8 igb3: using 1024 tx descriptors and 1024 rx descriptors igb3: msix_init qsets capped at 8 igb3: pxm cpus: 4 queue msgs: 9 admincnt: 1 igb3: using 4 rx queues 4 tx queues igb3: Using MSIX interrupts with 5 vectors igb3: allocated for 4 tx_queues igb3: allocated for 4 rx_queues igb3: Ethernet address: 00:25:90:09:c8:db igb3: netmap queues/slots: TX 4/1024, RX 4/1024 pcib4: at device 7.0 on pci0 pci4: on pcib4 pcib5: at device 9.0 on pci0 pci5: on pcib5 pci0: at device 20.0 (no driver attached) pci0: at device 20.1 (no driver attached) pci0: at device 20.2 (no driver attached) pci0: at device 20.3 (no driver attached) uhci0: port 0xcc00-0xcc1f irq 16 at device 26.0 on pci0 (XEN) d0: bind: m_gsi=16 g_gsi=16 uhci0: LegSup = 0x2f00 usbus0 on uhci0 usbus0: 12Mbps Full Speed USB v1.0 uhci1: port 0xc880-0xc89f irq 21 at device 26.1 on pci0 (XEN) d0: bind: m_gsi=21 g_gsi=21 uhci1: LegSup = 0x2f00 usbus1 on uhci1 usbus1: 12Mbps Full Speed USB v1.0 uhci2: port 0xc800-0xc81f irq 19 at device 26.2 on pci0 (XEN) d0: bind: m_gsi=19 g_gsi=19 uhci2: LegSup = 0x2f00 usbus2 on uhci2 usbus2: 12Mbps Full Speed USB v1.0 ehci0: mem 0xfbeda000-0xfbeda3ff irq 18 at device 26.7 on pci0 (XEN) d0: bind: m_gsi=18 g_gsi=18 usbus3: EHCI version 1.0 usbus3 on ehci0 usbus3: 480Mbps High Speed USB v2.0 uhci3: port 0xc480-0xc49f irq 23 at device 29.0 on pci0 (XEN) d0: bind: m_gsi=23 g_gsi=23 uhci3: LegSup = 0x2f00 usbus4 on uhci3 usbus4: 12Mbps Full Speed USB v1.0 uhci4: port 0xc400-0xc41f irq 19 at device 29.1 on pci0 uhci4: LegSup = 0x2f00 usbus5 on uhci4 usbus5: 12Mbps Full Speed USB v1.0 uhci5: port 0xc080-0xc09f irq 18 at device 29.2 on pci0 uhci5: LegSup = 0x2f00 usbus6 on uhci5 usbus6: 12Mbps Full Speed USB v1.0 ehci1: mem 0xfbed8000-0xfbed83ff irq 23 at device 29.7 on pci0 usbus7: EHCI version 1.0 usbus7 on ehci1 usbus7: 480Mbps High Speed USB v2.0 pcib6: at device 30.0 on pci0 pci6: on pcib6 vgapci0: mem 0xf9000000-0xf9ffffff,0xfaffc000-0xfaffffff,0xfb000000-0xfb7fffff irq 18 at device 1.0 on pci6 vgapci0: Boot video device isab0: at device 31.0 on pci0 isa0: on isab0 ahci0: port 0xb480-0xb487,0xc000-0xc003,0xbc00-0xbc07,0xb880-0xb883,0xb800-0xb81f mem 0xfbed6000-0xfbed67ff irq 19 at device 31.2 on pci0 ahci0: AHCI v1.20 with 6 3Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahcich4: at channel 4 on ahci0 ahcich5: at channel 5 on ahci0 ahciem0: on ahci0 acpi_button0: on acpi0 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 (XEN) d0: bind: m_gsi=4 g_gsi=4 xenpv0: on motherboard granttable0: on xenpv0 xen_et0: on xenpv0 Event timer "XENTIMER" frequency 1000000000 Hz quality 950 Timecounter "XENTIMER" frequency 1000000000 Hz quality 950 xen_et0: registered as a time-of-day clock, resolution 0.000001s xenstore0: on xenpv0 xsd_dev0: on xenpv0 evtchn0: on xenpv0 privcmd0: on xenpv0 gntdev0: on xenpv0 debug0: on xenpv0 xc0: on xenpv0 ipmi0: on isa0 ipmi0: KCS mode found at io 0xca2 alignment 0x1 on isa orm0: at iomem 0xc0000-0xc7fff,0xc8000-0xc8fff,0xc9000-0xc9fff,0xca000-0xcafff pnpid ORM0000 on isa0 vga0: at port 0x3d0-0x3db iomem 0xb8000-0xbffff pnpid PNP0900 on isa0 atkbdc0: at port 0x60,0x64 on isa0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 (XEN) d0: bind: m_gsi=1 g_gsi=1 atkbd0: [GIANT-LOCKED] atkbdc0: non-PNP ISA device will be removed from GENERIC in FreeBSD 12. Timecounters tick every 10.000 msec ipmi0: IPMI device rev. 1, firmware rev. 3.13, version 2.0, device support mask 0xbf ipmi0: Number of channels 2 ipmi0: Attached watchdog ipmi0: Establishing power cycle handler ugen0.1: at usbus0 ugen7.1: at usbus7 uhub0: on usbus0 ugen6.1: at usbus6 ugen4.1: at usbus4 ugen2.1: at usbus2 uhub1: on usbus7 uhub2: on usbus4 ugen1.1: at usbus1 uhub4: on usbus2 ugen3.1: at usbus3 uhub5: on usbus1 uhub3: on usbus6 ugen5.1: at usbus5 uhub6: on usbus3 uhub7: on usbus5 uhub0: 2 ports with 2 removable, self powered uhub4: 2 ports with 2 removable, self powered uhub2: 2 ports with 2 removable, self powered uhub3: 2 ports with 2 removable, self powered uhub5: 2 ports with 2 removable, self powered uhub7: 2 ports with 2 removable, self powered ses0 at ahciem0 bus 0 scbus6 target 0 lun 0 ses0: SEMB S-E-S 2.00 device ses0: SEMB SES Device ada0 at ahcich0 bus 0 scbus0 target 0 lun 0 ada0: ACS-3 ATA SATA 3.x device ada0: Serial Number ZGY0KSAS ada0: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) ada0: Command Queueing enabled ada0: 3815447MB (7814037168 512 byte sectors) ada0: quirks=0x1<4K> ada1 at ahcich1 bus 0 scbus1 target 0 lun 0 ada1: ACS-3 ATA SATA 3.x device ada1: Serial Number ZGY0KSC9 ada1: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) ada1: Command Queueing enabled ada1: 3815447MB (7814037168 512 byte sectors) ada1: quirks=0x1<4K> ada2 at ahcich2 bus 0 scbus2 target 0 lun 0 ada2: ACS-3 ATA SATA 3.x device ada2: Serial Number ZGY0KS9B ada2: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) ada2: Command Queueing enabled ada2: 3815447MB (7814037168 512 byte sectors) ada2: quirks=0x1<4K> ada3 at ahcich3 bus 0 scbus3 target 0 lun 0 ada3: ACS-3 ATA SATA 3.x device ada3: Serial Number ZDH1SGEB ada3: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) ada3: Command Queueing enabled ada3: 3815447MB (7814037168 512 byte sectors) ada3: quirks=0x1<4K> Trying to mount root from ufs:/dev/gpt/gptroot [rw]... uhub1: 6 ports with 6 removable, self powered uhub6: 6 ports with 6 removable, self powered cd0 at ahcich4 bus 0 scbus4 target 0 lun 0 cd0: Removable CD-ROM SCSI device cd0: 150.000MB/s transfers (SATA 1.x, UDMA2, ATAPI 12bytes, PIO 8192bytes) cd0: Attempt to query device size failed: NOT READY, Medium not present - tray closed GEOM_MIRROR: Device mirror/gm0 launched (1/2). GEOM_MIRROR: Device gm0: rebuilding provider ada2. WARNING: /mnt was not properly dismounted ugen1.2: at usbus1 ukbd0 on uhub5 ukbd0: on usbus1 kbd2 at ukbd0 Setting hostuuid: 49434d53-0200-9009-2500-09902500dac8. Setting hostid: 0x0535156f. ZFS NOTICE: Prefetch is disabled by default if less than 4GB of RAM is present; to enable, add "vfs.zfs.prefetch_disable=0" to /boot/loader.conf. ZFS filesystem version: 5 ZFS storage pool version: features support (5000) Starting file system checks: /dev/gpt/gptroot: DEFER FOR BACKGROUND CHECKING WARNING: / was not properly dismounted Mounting local filesystems:. ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/gcc9 /usr/local/lib/perl5/5.30/mach/CORE 32-bit compatibility ldconfig path: /usr/lib32 Setting hostname: xen3.via.net. Setting up harvesting: [UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,NET_ETHER,NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED Feeding entropy: . bridge0: Ethernet address: 02:05:35:15:6f:00 Created clone interfaces: bridge0. lo0: link state changed to UP ifconfig: BRDGADD vlan34: No such file or directory igb0: link state changed to UP Starting Network: lo0 igb0 igb1 igb2 igb3 bridge0. lo0: flags=8049 metric 0 mtu 16384 options=680003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x5 inet 127.0.0.1 netmask 0xff000000 groups: lo nd6 options=21 igb0: flags=8843 metric 0 mtu 1500 options=e527bb ether 00:25:90:36:fd:2e inet 209.81.0.202 netmask 0xffffff00 broadcast 209.81.0.255 media: Ethernet autoselect (1000baseT ) status: active nd6 options=29 igb1: flags=8843 metric 0 mtu 1500 options=e527bb ether 00:25:90:36:fd:2f igb1: link state changed to UP media: Ethernet autoselect (1000baseT ) status: active nd6 options=29 igb2: flags=8802 metric 0 mtu 1500 options=e527bb ether 00:25:90:09:c8:da media: Ethernet autoselect status: no carrier nd6 options=29 igb3: flags=8802 metric 0 mtu 1500 options=e527bb ether 00:25:90:09:c8:db media: Ethernet autoselect status: no carrier nd6 options=29 bridge0: flags=8843 metric 0 mtu 1500 ether 02:05:35:15:6f:00 id 00:00:00:00:00:00 priority 32768 hellotime 2 fwddelay 15 maxage 20 holdcnt 6 proto rstp maxaddr 2000 timeout 1200 root id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0 groups: bridge nd6 options=9 Starting devd. Starting Network: igb2. igb2: flags=8802 metric 0 mtu 1500 options=e527bb ether 00:25:90:09:c8:da media: Ethernet autoselect status: no carrier nd6 options=29 Starting Network: igb3. igb3: flags=8802 metric 0 mtu 1500 options=e527bb ether 00:25:90:09:c8:db media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: ioat.ko ioat0: mem 0xfbef8000-0xfbefbfff irq 43 at device 22.0 on pci0 ioat0: Capabilities: 77 ioat1: mem 0xfbef4000-0xfbef7fff irq 44 at device 22.1 on pci0 ioat1: Capabilities: 77 ioat2: mem 0xfbef0000-0xfbef3fff irq 45 at device 22.2 on pci0 ioat2: Capabilities: 77 ioat3: mem 0xfbeec000-0xfbeeffff irq 46 at device 22.3 on pci0 ioat3: Capabilities: 77 ioat4: mem 0xfbee8000-0xfbeebfff irq 43 at device 22.4 on pci0 ioat4: Capabilities: 77 ioat5: mem 0xfbee4000-0xfbee7fff irq 44 at device 22.5 on pci0 ioat5: Capabilities: 77 ioat6: mem 0xfbee0000-0xfbee3fff irq 45 at device 22.6 on pci0 ioat6: Capabilities: 77 ioat7: mem 0xfbedc000-0xfbedffff irq 46 at device 22.7 on pci0 ioat7: Capabilities: 77 Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: uhid.ko Autoloading module: ums.ko ums0 on uhub5 ums0: on usbus1 Starting ums0 moused. add host 127.0.0.1: gateway lo0 fib 0: route already in table add net default: gateway 209.81.0.1 add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Starting syslogd. Setting date via ntp. Error resolving clock.via.net: hostname nor servname provided, or not known (8) 14 Oct 14:22:27 ntpdate[1145]: Can't find host clock.via.net: hostname nor servname provided, or not known (8) 14 Oct 14:22:27 ntpdate[1145]: no servers can be used, exiting Clearing /tmp (X related). Cleaning xenstore database. Starting xenservices: xenstored, xenconsoled.Oct 14 14:22:28 xen3 xenstored[1271]: Checking store ... Oct 14 14:22:28 xen3 xenstored[1271]: Checking store complete. xs_dev0: on xenstore0 xenbusb_front0: on xenstore0 xenbusb_back0: on xenstore0 xenballoon0: on xenstore0 xctrl0: on xenstore0 Setting domain 0 name, domid and JSON config... Done setting up Dom0 Updating motd:. Mounting late filesystems:. Configuring vt: blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting sendmail_submit. Starting sendmail_msp_queue. Starting cron. Oct 14 14:22:34 xen3 sm-mta[1345]: x9C3a8eu001413: SYSERR(root): hash map "Alias0": missing map file /etc/mail/aliases.db: No such file or directory Starting background file system checks in 60 seconds. Mon Oct 14 14:22:35 PDT 2019 Oct 14 14:22:35 xen3 getty[1410]: open /dev/ttyu1: No such file or directory Oct 14 14:22:35 xen3 getty[1411]: open /dev/ttyu1: No such file or directory Oct 14 14:22:35 xen3 getty[1412]: open /dev/ttyu1: No such file or directory Oct 14 14:22:35 xen3 getty[1413]: open /dev/ttyu1: No such file or directory Oct 14 14:22:35 xen3 init[1414]: getty repeating too quickly on port /dev/ttyu1, sleeping 30 secs Oct 14 14:23:05 xen3 getty[1414]: open /dev/ttyu1: No such file or directory Oct 14 14:23:05 xen3 getty[1415]: open /dev/ttyu1: No such file or directory Oct 14 14:23:05 xen3 getty[1416]: open /dev/ttyu1: No such file or directory Oct 14 14:23:05 xen3 getty[1417]: open /dev/ttyu1: No such file or directory Oct 14 14:23:05 xen3 getty[1418]: open /dev/ttyu1: No such file or directory Oct 14 14:23:05 xen3 init[1419]: getty repeating too quickly on port /dev/ttyu1, sleeping 30 secs Oct 14 14:23:35 xen3 getty[1419]: open /dev/ttyu1: No such file or directory Oct 14 14:23:35 xen3 getty[1422]: open /dev/ttyu1: No such file or directory Oct 14 14:23:35 xen3 getty[1423]: open /dev/ttyu1: No such file or directory Oct 14 14:23:35 xen3 getty[1424]: open /dev/ttyu1: No such file or directory Oct 14 14:23:35 xen3 getty[1425]: open /dev/ttyu1: No such file or directory Oct 14 14:23:35 xen3 init[1426]: getty repeating too quickly on port /dev/ttyu1, sleeping 30 secs dev = gpt/gptroot, block = 1, fs = / panic: ffs_blkfree_cg: freeing free block cpuid = 2 time = 1571088217 KDB: stack backtrace: #0 0xffffffff80be78d7 at kdb_backtrace+0x67 #1 0xffffffff80b9b4b3 at vpanic+0x1a3 #2 0xffffffff80b9b303 at panic+0x43 #3 0xffffffff80e87345 at ffs_blkrelease_finish+0x6e5 #4 0xffffffff80e8433d at ffs_blkfree+0xad #5 0xffffffff80eb10af at softdep_get_depcounts+0x48bf #6 0xffffffff80eb0fe5 at softdep_get_depcounts+0x47f5 #7 0xffffffff80ea195a at softdep_update_inodeblock+0x178a #8 0xffffffff80eab94a at softdep_request_cleanup+0xa8a #9 0xffffffff80e95272 at softdep_flushworklist+0x1a2 #10 0xffffffff80e991df at softdep_unmount+0x4af #11 0xffffffff80b5be83 at fork_exit+0x83 #12 0xffffffff8105061e at fork_trampoline+0xe Uptime: 1m59s Automatic reboot in 15 seconds - press a key on the console to abort Rebooting... cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 2 (XEN) d0v2 Unexpected vmexit: reason 3 (XEN) d0v0 Unexpected vmexit: reason 3 (XEN) d0v1 Unexpected vmexit: reason 3 (XEN) d0v3 Unexpected vmexit: reason 3 (XEN) domain_crash called from vmx.c:4181 (XEN) domain_crash called from vmx.c:4181 (XEN) domain_crash called from vmx.c:4181 (XEN) domain_crash called from vmx.c:4181 (XEN) Domain 0 (vcpu#2) crashed on cpu#10: (XEN) Domain 0 (vcpu#0) crashed on cpu#12: (XEN) Domain 0 (vcpu#1) crashed on cpu#3: (XEN) Domain 0 (vcpu#3) crashed on cpu#4: (XEN) ----[ Xen-4.12.1 x86_64 debug=n Tainted: C ]---- (XEN) CPU: 10 (XEN) RIP: 0020:[] (XEN) RFLAGS: 0000000000000002 CONTEXT: hvm guest (d0v2) (XEN) rax: 00000000000000aa rbx: fffff80003061a40 rcx: 0000000000000001 (XEN) rdx: fffffe002ec63530 rsi: 0000000000000001 rdi: 0000000000000000 (XEN) rbp: fffffe002ec63660 rsp: fffffe002ec63630 r8: 0000000000000001 (XEN) r9: fffffe002ec63530 r10: 000000000000001a r11: 0000000000000001 (XEN) r12: fffff8000644f000 r13: fffff80003069628 r14: 0000000000000000 (XEN) r15: fffff80003069600 cr0: 000000008005003b cr4: 00000000000006e0 (XEN) cr3: 00000000026a3000 cr2: 00000000002aab70 (XEN) fsb: 0000000800322830 gsb: ffffffff82014300 gss: 0000000000000000 (XEN) ds: 003b es: 003b fs: 0013 gs: 001b ss: 0028 cs: 0020 (XEN) ----[ Xen-4.12.1 x86_64 debug=n Tainted: C ]---- (XEN) CPU: 12 (XEN) RIP: 0020:[] (XEN) RFLAGS: 0000000000000087 CONTEXT: hvm guest (d0v0) (XEN) rax: 0000000069cf48c9 rbx: 0000000000000000 rcx: 0000004fadbd25b9 (XEN) rdx: 000000000000004f rsi: 0000004f69cccf55 rdi: 000000000007a120 (XEN) rbp: fffffe0025d117f0 rsp: fffffe0025d117b0 r8: 0000000000000001 (XEN) r9: fffffe0025d11720 r10: 000000000000001f r11: 0000000000000001 (XEN) r12: fffff80003257980 r13: 0000000000000001 r14: fffffe0025d11960 (XEN) r15: 0000000000000000 cr0: 000000008005003b cr4: 00000000000006e0 (XEN) cr3: 00000000026a3000 cr2: 0000000800337fcc (XEN) fsb: 00000008002398d0 gsb: ffffffff82012300 gss: 0000000000000000 (XEN) ds: 003b es: 003b fs: 0013 gs: 001b ss: 0028 cs: 0020 (XEN) ----[ Xen-4.12.1 x86_64 debug=n Tainted: C ]---- (XEN) CPU: 3 (XEN) RIP: 0020:[] (XEN) RFLAGS: 0000000000000046 CONTEXT: hvm guest (d0v1) (XEN) rax: 0000000000000000 rbx: 0000000000000001 rcx: 0000000000000000 (XEN) rdx: 0000000000000002 rsi: 0000000000000002 rdi: ffffffff82121e90 (XEN) rbp: fffffe0025c5f880 rsp: fffffe0025c5f870 r8: 0000001f9fdafdd5 (XEN) r9: 00000000000000fa r10: 00000000000000fa r11: 000000007fff3fa4 (XEN) r12: fffff80003257080 r13: 0000000000000001 r14: fffffe0025c5f9a0 (XEN) r15: 0000000000000000 cr0: 000000008005003b cr4: 00000000000006e0 (XEN) cr3: 00000000026a3000 cr2: 00000008006a3000 (XEN) fsb: 000000080025a8d0 gsb: ffffffff82013300 gss: 0000000000000000 (XEN) ds: 003b es: 003b fs: 0013 gs: 001b ss: 0028 cs: 0020 (XEN) ----[ Xen-4.12.1 x86_64 debug=n Tainted: C ]---- (XEN) CPU: 4 (XEN) RIP: 0020:[] (XEN) RFLAGS: 0000000000000046 CONTEXT: hvm guest (d0v3) (XEN) rax: 0000000000000000 rbx: 0000000000000003 rcx: 0000000000000000 (XEN) rdx: 0000000000000008 rsi: 000000000000000a rdi: ffffffff82122110 (XEN) rbp: fffffe0025c69880 rsp: fffffe0025c69870 r8: 0000001f9fdafce8 (XEN) r9: 00000000000000fa r10: 00000000000000fa r11: 000000007fff3fda (XEN) r12: fffff80003255d80 r13: 0000000000000001 r14: fffffe0025c699a0 (XEN) r15: 0000000000000000 cr0: 000000008005003b cr4: 00000000000006e0 (XEN) cr3: 00000000026a3000 cr2: 0000000800681000 (XEN) fsb: 000000080025a8d0 gsb: ffffffff82015300 gss: 0000000000000000 (XEN) ds: 003b es: 003b fs: 0013 gs: 001b ss: 0028 cs: 0020 (XEN) Hardware Dom0 crashed: rebooting machine in 5 seconds. From owner-freebsd-xen@freebsd.org Tue Oct 15 08:27:02 2019 Return-Path: Delivered-To: freebsd-xen@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 795C11577B2 for ; Tue, 15 Oct 2019 08:27:02 +0000 (UTC) (envelope-from royger@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 46spSQ2gTPz3NLF; Tue, 15 Oct 2019 08:27:02 +0000 (UTC) (envelope-from royger@freebsd.org) Received: from localhost (unknown [212.230.157.24]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) (Authenticated sender: royger) by smtp.freebsd.org (Postfix) with ESMTPSA id D15C610EFB; Tue, 15 Oct 2019 08:27:01 +0000 (UTC) (envelope-from royger@freebsd.org) Date: Tue, 15 Oct 2019 10:26:55 +0200 From: Roger Pau =?iso-8859-1?Q?Monn=E9?= To: Brian Buhrow Cc: freebsd-xen@freebsd.org Subject: Re: i/o is very slow on FreeBSD dom0 with Xen-4.12 and Freebsd-12 Message-ID: <20191015082655.GB14005@Air-de-Roger> References: <201910142145.x9ELj4c8008732@lothlorien.nfbcal.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <201910142145.x9ELj4c8008732@lothlorien.nfbcal.org> User-Agent: Mutt/1.12.2 (2019-09-21) X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 15 Oct 2019 08:27:02 -0000 On Mon, Oct 14, 2019 at 02:45:04PM -0700, Brian Buhrow wrote: > hello. Using: ioapic_ack=old causes the dom0 to crash. Below are the > logs. Does the crash happen every time you boot with ioapic_ack=old? [...] > dev = gpt/gptroot, block = 1, fs = / > panic: ffs_blkfree_cg: freeing free block > cpuid = 2 > time = 1571088217 > KDB: stack backtrace: > #0 0xffffffff80be78d7 at kdb_backtrace+0x67 > #1 0xffffffff80b9b4b3 at vpanic+0x1a3 > #2 0xffffffff80b9b303 at panic+0x43 > #3 0xffffffff80e87345 at ffs_blkrelease_finish+0x6e5 > #4 0xffffffff80e8433d at ffs_blkfree+0xad > #5 0xffffffff80eb10af at softdep_get_depcounts+0x48bf > #6 0xffffffff80eb0fe5 at softdep_get_depcounts+0x47f5 > #7 0xffffffff80ea195a at softdep_update_inodeblock+0x178a > #8 0xffffffff80eab94a at softdep_request_cleanup+0xa8a > #9 0xffffffff80e95272 at softdep_flushworklist+0x1a2 > #10 0xffffffff80e991df at softdep_unmount+0x4af > #11 0xffffffff80b5be83 at fork_exit+0x83 > #12 0xffffffff8105061e at fork_trampoline+0xe > Uptime: 1m59s > Automatic reboot in 15 seconds - press a key on the console to abort This looks like a file system error, likely some corruption caused by previous reboots? Ie: I'm not sure this is caused by Xen or rather by underlying errors in the filesystem. At least there are no hardware errors on the log AFAICT. Thanks, Roger. From owner-freebsd-xen@freebsd.org Tue Oct 15 15:56:28 2019 Return-Path: Delivered-To: freebsd-xen@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id BA3BE14BD59 for ; Tue, 15 Oct 2019 15:56:28 +0000 (UTC) (envelope-from buhrow@lothlorien.nfbcal.org) Received: from lothlorien.nfbcal.org (ns.NFBCAL.ORG [157.22.230.125]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "nfbcal.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 46t0R03hLTz4Q5y; Tue, 15 Oct 2019 15:56:28 +0000 (UTC) (envelope-from buhrow@lothlorien.nfbcal.org) Received: from lothlorien.nfbcal.org (localhost [127.0.0.1]) by lothlorien.nfbcal.org (8.15.2/8.14.1-NFBNETBSD) with ESMTPS id x9FFuNaZ010075 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Tue, 15 Oct 2019 08:56:23 -0700 (PDT) X-Virus-Status: Clean X-Virus-Scanned: clamav-milter 0.97.3 at lothlorien.nfbcal.org Received: (from buhrow@localhost) by lothlorien.nfbcal.org (8.15.2/8.12.11) id x9FFuNUA011130; Tue, 15 Oct 2019 08:56:23 -0700 (PDT) Message-Id: <201910151556.x9FFuNUA011130@lothlorien.nfbcal.org> From: Brian Buhrow Date: Tue, 15 Oct 2019 08:56:22 -0700 In-Reply-To: <20191015082655.GB14005@Air-de-Roger> X-Mailer: Mail User's Shell (7.2.6 beta(4.pl1)+dynamic 20000103) To: Roger Pau =?iso-8859-1?Q?Monn=E9?= Subject: Re: i/o is very slow on FreeBSD dom0 with Xen-4.12 and Freebsd-12 Cc: freebsd-xen@freebsd.org, buhrow@nfbcal.org X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.4.3 (lothlorien.nfbcal.org [127.0.0.1]); Tue, 15 Oct 2019 08:56:24 -0700 (PDT) X-Rspamd-Queue-Id: 46t0R03hLTz4Q5y X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-6.00 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-0.996,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; REPLY(-4.00)[] X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 15 Oct 2019 15:56:28 -0000 hello Roger. Sorry, my bad. I didn't even look at the cause of the panic. Rebooting the system caused it to come up clean after another pass with fsck. With the ioapic_ack=old argument, the system comes up right away and is quite responsive. Can you explain how to select which argument to use on the command line if the autoselection code doesn't work? Thank you for your help! -Brian On Oct 15, 10:26am, Roger Pau =?iso-8859-1?Q?Monn=E9?= wrote: } Subject: Re: i/o is very slow on FreeBSD dom0 with Xen-4.12 and Freebsd-12 } On Mon, Oct 14, 2019 at 02:45:04PM -0700, Brian Buhrow wrote: } > hello. Using: ioapic_ack=old causes the dom0 to crash. Below are the } > logs. } } Does the crash happen every time you boot with ioapic_ack=old? } } [...] } > dev = gpt/gptroot, block = 1, fs = / } > panic: ffs_blkfree_cg: freeing free block } > cpuid = 2 } > time = 1571088217 } > KDB: stack backtrace: From owner-freebsd-xen@freebsd.org Tue Oct 15 21:12:14 2019 Return-Path: Delivered-To: freebsd-xen@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id EA96F154B31 for ; Tue, 15 Oct 2019 21:12:14 +0000 (UTC) (envelope-from sparvu@kronometrix.org) Received: from mail.kronometrix.org (mail.kronometrix.org [95.85.46.90]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mail.kronometrix.org", Issuer "mail.kronometrix.org" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 46t7RK6QLWz3Mj1 for ; Tue, 15 Oct 2019 21:12:13 +0000 (UTC) (envelope-from sparvu@kronometrix.org) Received: from [192.168.1.4] (mail.kronometrix.com [79.134.105.181]) (authenticated bits=0) by mail.kronometrix.org (8.15.2/8.15.2) with ESMTPSA id x9FLCBVX081414 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO) for ; Tue, 15 Oct 2019 21:12:12 GMT (envelope-from sparvu@kronometrix.org) X-Authentication-Warning: mail.kronometrix.org: Host mail.kronometrix.com [79.134.105.181] claimed to be [192.168.1.4] From: Stefan Parvu Mime-Version: 1.0 (Mac OS X Mail 12.4 \(3445.104.11\)) Subject: cannot install FreeBSD 12.0 Xen 4.12.1 on Intel Core i7 CPU 930 Message-Id: Date: Wed, 16 Oct 2019 00:12:06 +0300 To: freebsd-xen@freebsd.org X-Mailer: Apple Mail (2.3445.104.11) X-Rspamd-Queue-Id: 46t7RK6QLWz3Mj1 X-Spamd-Bar: + Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of sparvu@kronometrix.org designates 95.85.46.90 as permitted sender) smtp.mailfrom=sparvu@kronometrix.org X-Spamd-Result: default: False [1.55 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain,multipart/related]; PREVIOUSLY_DELIVERED(0.00)[freebsd-xen@freebsd.org]; HAS_XAW(0.00)[]; NEURAL_SPAM_MEDIUM(0.56)[0.562,0]; RCPT_COUNT_ONE(0.00)[1]; TO_DN_NONE(0.00)[]; MV_CASE(0.50)[]; NEURAL_SPAM_LONG(0.18)[0.176,0]; DMARC_NA(0.00)[kronometrix.org]; IP_SCORE(0.62)[ip: (0.38), ipnet: 95.85.0.0/18(1.04), asn: 14061(1.71), country: US(-0.05)]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:+,3:~,4:~]; ASN(0.00)[asn:14061, ipnet:95.85.0.0/18, country:US]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 15 Oct 2019 21:12:15 -0000 Hi, I have a bit of problem, cannot install FreeBSD/Xen on a bit older = hardware. The hardware=20 should support the minimal VT-D/IOMMU settings, required by Xen. CPU: Intel(R) Core(TM) i7 CPU 930 @ 2.80GHz (2806.42-MHz = K8-class CPU) Origin=3D"GenuineIntel" Id=3D0x106a5 Family=3D0x6 Model=3D0x1a = Stepping=3D5 = Features=3D0xbfebfbff = Features2=3D0x98e3bd AMD Features=3D0x28100800 AMD Features2=3D0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,VPID TSC: P-state invariant, performance statistics I get always a panic on CPU0 followed by a reboot. My /boot/loader.conf = was set as: xen_cmdline=3D"dom0_mem=3D2048M dom0_max_vcpus=3D4 dom0=3Dpvh = console=3Dcom1,vga com1=3D115200,8n1 guest_loglvl=3Dall loglvl=3Dall = iommu=3Ddebug,force=E2=80=9D Any ideas what I could try ? Thank you Stefan Parvu sparvu@kronometrix.org From owner-freebsd-xen@freebsd.org Tue Oct 15 21:53:54 2019 Return-Path: Delivered-To: freebsd-xen@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id CD404155757 for ; Tue, 15 Oct 2019 21:53:54 +0000 (UTC) (envelope-from saper@saper.info) Received: from m.saper.info (m.saper.info [IPv6:2a01:4f8:a0:7383::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "saper.info", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 46t8MP5rMwz3QDV for ; Tue, 15 Oct 2019 21:53:53 +0000 (UTC) (envelope-from saper@saper.info) Received: from m.saper.info (saper@m.saper.info [IPv6:2a01:4f8:a0:7383:0:0:0:0]) by m.saper.info (8.15.2/8.15.2) with ESMTPS id x9FLrj7l018740 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Tue, 15 Oct 2019 21:53:45 GMT (envelope-from saper@saper.info) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=saper.info; s=Sep2014; t=1571176425; bh=jJYV4QowpL9v22j+s4ej1BCEZVeEUQJpeuEpS4gv9mo=; h=Date:From:To:cc:Subject:In-Reply-To:References; b=iGl9Crjh5P76DcPOfBP3yC6QwMCttNZkF6vfODT4sFOwybTT32/imfBOzISOcXE1o q6rPsDKmeXhwHdr8YSwbVy2U2q/1wyvsXn8TeOGpmsr8BLprLNoNT0vcTsi7tmqxNC sggKedoMaxQM5K1gKlBK3hmrz5SOMAH8KX4sSgqI= Received: from localhost (saper@localhost) by m.saper.info (8.15.2/8.15.2/Submit) with ESMTP id x9FLrif6018737; Tue, 15 Oct 2019 21:53:45 GMT (envelope-from saper@saper.info) X-Authentication-Warning: m.saper.info: saper owned process doing -bs Date: Tue, 15 Oct 2019 21:53:44 +0000 From: Marcin Cieslak To: Stefan Parvu cc: freebsd-xen@freebsd.org Subject: Re: cannot install FreeBSD 12.0 Xen 4.12.1 on Intel Core i7 CPU 930 In-Reply-To: Message-ID: References: MIME-Version: 1.0 Content-Type: multipart/signed; protocol="application/pkcs7-signature"; micalg=sha-256; boundary="1563967779-593110539-1571176425=:87688" X-Rspamd-Queue-Id: 46t8MP5rMwz3QDV X-Spamd-Bar: ------- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=saper.info header.s=Sep2014 header.b=iGl9Crjh; dmarc=none; spf=none (mx1.freebsd.org: domain of saper@saper.info has no SPF policy when checking 2a01:4f8:a0:7383::) smtp.mailfrom=saper@saper.info X-Spamd-Result: default: False [-7.14 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[saper.info:s=Sep2014]; FROM_HAS_DN(0.00)[]; SIGNED_SMIME(-2.00)[]; TO_DN_SOME(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; HAS_ATTACHMENT(0.00)[]; HAS_XAW(0.00)[]; DMARC_NA(0.00)[saper.info]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[saper.info:+]; RCPT_COUNT_TWO(0.00)[2]; R_SPF_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:24940, ipnet:2a01:4f8::/29, country:DE]; RCVD_COUNT_TWO(0.00)[2]; IP_SCORE(-2.74)[ip: (-9.79), ipnet: 2a01:4f8::/29(-2.10), asn: 24940(-1.81), country: DE(-0.01)] X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 15 Oct 2019 21:53:54 -0000 --1563967779-593110539-1571176425=:87688 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8BIT On Wed, 16 Oct 2019, Stefan Parvu wrote: > Hi, > > I have a bit of problem, cannot install FreeBSD/Xen on a bit older hardware. The hardware > should support the minimal VT-D/IOMMU settings, required by Xen. > > CPU: Intel(R) Core(TM) i7 CPU 930 @ 2.80GHz (2806.42-MHz K8-class CPU) > Origin="GenuineIntel" Id=0x106a5 Family=0x6 Model=0x1a Stepping=5 > Features=0xbfebfbff > Features2=0x98e3bd > AMD Features=0x28100800 > AMD Features2=0x1 > VT-x: PAT,HLT,MTF,PAUSE,EPT,VPID > TSC: P-state invariant, performance statistics > > I get always a panic on CPU0 followed by a reboot. My /boot/loader.conf was set as: > > xen_cmdline="dom0_mem=2048M dom0_max_vcpus=4 dom0=pvh console=com1,vga com1=115200,8n1 guest_loglvl=all loglvl=all iommu=debug,force” Does it happen in Xen or in FreeBSD dom0 kernel? I have Xeon E3-1234 but I run 11.2-STABLE with xen-kernel-4.7.2_9 for a very long time already. I also have: hw.pci.mcfg=0 machdep.hyperthreading_allowed=0 Marcin --1563967779-593110539-1571176425=:87688 Content-Type: application/pkcs7-signature; name=smime.p7s Content-Transfer-Encoding: BASE64 Content-Description: S/MIME Cryptographic Signature Content-Disposition: attachment; filename=smime.p7s MIIOSwYJKoZIhvcNAQcCoIIOPDCCDjgCAQExDzANBglghkgBZQMEAgEFADAL BgkqhkiG9w0BBwGgggqQMIIElzCCA3+gAwIBAgIOSBtqCKJEiNNcmz3JSA0w DQYJKoZIhvcNAQELBQAwTDEgMB4GA1UECxMXR2xvYmFsU2lnbiBSb290IENB IC0gUjMxEzARBgNVBAoTCkdsb2JhbFNpZ24xEzARBgNVBAMTCkdsb2JhbFNp Z24wHhcNMTYwNjE1MDAwMDAwWhcNMjQwNjE1MDAwMDAwWjBdMQswCQYDVQQG EwJCRTEZMBcGA1UEChMQR2xvYmFsU2lnbiBudi1zYTEzMDEGA1UEAxMqR2xv YmFsU2lnbiBQZXJzb25hbFNpZ24gMSBDQSAtIFNIQTI1NiAtIEczMIIBIjAN BgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAyrCba00KOKyGuwh9h+/MAcZm ZUF9OxGKA56AADHaDE08rB0WEbgm6J4XvJP3OGQ7cgHdVJu6XMZkRd6EcfjD yRrIwE6oAVWJe57co3gKk/XxvuubSZuUahrcOiv3D2qaHwva4zumubxQQI4f unEzRIJHPiNjaq0cCcZsMcp5pxsEz8aG0sr8Oh80sxKNnzPmuUETLESktfMC pQKHUGmWXLsG6sgCZOezUjDjKpPKW7l4PUt0TEBEyqLhifv9/YPn5C4o10PP daDazZPeKNif2PVQ5u0HRnkFrHh4wmmrMtY22Mse3eR01gD6rEEGWf+gdzuy EQE+ZVlNhCP4gXjdBQIDAQABo4IBZDCCAWAwDgYDVR0PAQH/BAQDAgEGMCcG A1UdJQQgMB4GCCsGAQUFBwMCBggrBgEFBQcDBAYIKwYBBQUHAwkwEgYDVR0T AQH/BAgwBgEB/wIBADAdBgNVHQ4EFgQUlifCwqX3HPgCenpkr2NvMtKYwrEw HwYDVR0jBBgwFoAUj/BLf6guRSSuTVD6Y5qL3uLdG7wwPgYIKwYBBQUHAQEE MjAwMC4GCCsGAQUFBzABhiJodHRwOi8vb2NzcDIuZ2xvYmFsc2lnbi5jb20v cm9vdHIzMDYGA1UdHwQvMC0wK6ApoCeGJWh0dHA6Ly9jcmwuZ2xvYmFsc2ln bi5jb20vcm9vdC1yMy5jcmwwWQYDVR0gBFIwUDALBgkrBgEEAaAyASgwQQYJ KwYBBAGgMgFfMDQwMgYIKwYBBQUHAgEWJmh0dHBzOi8vd3d3Lmdsb2JhbHNp Z24uY29tL3JlcG9zaXRvcnkvMA0GCSqGSIb3DQEBCwUAA4IBAQCxh3ekjKKy RrUdfI6D1U7qUggdFLksiU+KiIqJzJG6GXcQ2KiBy2tF3+KYb0IixXMpIVli VXlcD5Vh4tiMxJ4WONMFt3f7/53gSXLf24WMwErubc+mGMzgUGE5HKC98PcK UV/5pPggQdzPxCBNeiXnLU1tCGYhPatFTDhUBGaVhBeuUCbgR9gpXJ9guqrD OVwouKvovdIeI5KEAcoAAiSL6naeLk/GbKUaBFa2RxXC17e+YyBWtWlWDEM3 1V8pUIx76lkO8IJYREhLcg/LnyoYy5wcrzI6pbX2vw1x/jR3GHSC1AEdoqbE xui2XLLlSa6y9yQNgdkPz7GTLmpwIT+dMIIF8TCCBNmgAwIBAgIMGk4Oe/1h 2+wMOby/MA0GCSqGSIb3DQEBCwUAMF0xCzAJBgNVBAYTAkJFMRkwFwYDVQQK ExBHbG9iYWxTaWduIG52LXNhMTMwMQYDVQQDEypHbG9iYWxTaWduIFBlcnNv bmFsU2lnbiAxIENBIC0gU0hBMjU2IC0gRzMwHhcNMTcwNTI1MDg0NDE2WhcN MjAwNTI1MDg0NDE2WjA8MRkwFwYDVQQDDBBzYXBlckBzYXBlci5pbmZvMR8w HQYJKoZIhvcNAQkBFhBzYXBlckBzYXBlci5pbmZvMIICIjANBgkqhkiG9w0B AQEFAAOCAg8AMIICCgKCAgEA2sO3aQNus/oe4ZBZ4fu1Y1mzxnUYAkb4k/dw gMFc2Kd0eRoOY0AHj4rTEi/vVzzizxjLbEwXzQ9cBEAu/PqS8WsOmhZXtlfi szPDmP7ZpOwmNTWKSd9O7jHu9uTCGfEOsocQNYH2ULD1gVFkgKb8jHf+3u9d uCzh6qMomTtwLrCGEP70Lq385xUzRaD6qbOeIB99tpzgvMR6Z0GPTt4z8tLM kfdtohq5llwZ5vYnj/hJohVS9iLMQMHW4nuLj/mLZNaYE1CWJBT1rBwn5YPJ uR6811O9eAP7aX4iG8k1jkiBh+QNgGRBIK4GIdqy7IVRhA7v2OlpLYHMk4zP 9Fs3M+56QromVKBnxfzLhuYMUK6ugj9jwskNVitqlEFUeyfgvmR1jnPRp1Nd XGJllTNwGicR8wkaRj14RxfrvTZfwXs8OBODKFupqun/tNzdpOgyHMGQACss 9yv2SnLGCJvJK3rGIdRZEiUhLZH/Ct4L92dBhev+SjUqWKbHb4yIlGMgLdoh nwqatuWw7iyOeInjcinX7ghiIKDWhulUN493Fzl6kaUBtIIcrb7jzZ2pHAQT WUmuVnCTHk6NtoWB09lvuK77fw4GfxLWDFWkBQiJYPVBrmxlrkCKzrWdTMfS W9BiEC10jT1sSimUBIjDz22RkfsApeBJoAIWjiOZogILu9MCAwEAAaOCAdAw ggHMMA4GA1UdDwEB/wQEAwIFoDCBngYIKwYBBQUHAQEEgZEwgY4wTQYIKwYB BQUHMAKGQWh0dHA6Ly9zZWN1cmUuZ2xvYmFsc2lnbi5jb20vY2FjZXJ0L2dz cGVyc29uYWxzaWduMXNoYTJnM29jc3AuY3J0MD0GCCsGAQUFBzABhjFodHRw Oi8vb2NzcDIuZ2xvYmFsc2lnbi5jb20vZ3NwZXJzb25hbHNpZ24xc2hhMmcz MEwGA1UdIARFMEMwQQYJKwYBBAGgMgEoMDQwMgYIKwYBBQUHAgEWJmh0dHBz Oi8vd3d3Lmdsb2JhbHNpZ24uY29tL3JlcG9zaXRvcnkvMAkGA1UdEwQCMAAw RAYDVR0fBD0wOzA5oDegNYYzaHR0cDovL2NybC5nbG9iYWxzaWduLmNvbS9n c3BlcnNvbmFsc2lnbjFzaGEyZzMuY3JsMBsGA1UdEQQUMBKBEHNhcGVyQHNh cGVyLmluZm8wHQYDVR0lBBYwFAYIKwYBBQUHAwIGCCsGAQUFBwMEMB0GA1Ud DgQWBBReBINaGUKUo7HCrIjsKLKERu6ooTAfBgNVHSMEGDAWgBSWJ8LCpfcc +AJ6emSvY28y0pjCsTANBgkqhkiG9w0BAQsFAAOCAQEAC0VK968ySq/6B+Kd ecjVThQOKtVXuG17Krfk0xz7OPYR/V+qZtBFm2Uc6tkUEmAmq3Tyf+SE3TTX Q58eJFq0uCTUhIY714ioJs1uVWBz8rPyJ3swkOfDaUXUxkQsBsf73VfKjUk4 kB5MTrApLYUe35NmEY3FqyyX13elhW1tp864vOKM2Git61cYoRn/bwd/z2JM Zkxwkd5JgvmM+p4Da+WO4CUsGzdrZEH8X/8NQIzWtUDIh7VEQZFX5fot/KvH Am8AajtpmNqTfMyg6LfcfJUXSFqXn/KEWu4Td62vX6Pd70dYKUZxnLwYvGqG A4Ktrp9zyrUzxLbmdaPln7CstjGCA38wggN7AgEBMG0wXTELMAkGA1UEBhMC QkUxGTAXBgNVBAoTEEdsb2JhbFNpZ24gbnYtc2ExMzAxBgNVBAMTKkdsb2Jh bFNpZ24gUGVyc29uYWxTaWduIDEgQ0EgLSBTSEEyNTYgLSBHMwIMGk4Oe/1h 2+wMOby/MA0GCWCGSAFlAwQCAQUAoIHkMBgGCSqGSIb3DQEJAzELBgkqhkiG 9w0BBwEwHAYJKoZIhvcNAQkFMQ8XDTE5MTAxNTIxNTM0NFowLwYJKoZIhvcN AQkEMSIEIEfwU2WaLo+HHK9kU1DwcEzUiT0TeXOKqBvZHzEWEYYsMHkGCSqG SIb3DQEJDzFsMGowCwYJYIZIAWUDBAEqMAsGCWCGSAFlAwQBFjALBglghkgB ZQMEAQIwCgYIKoZIhvcNAwcwDgYIKoZIhvcNAwICAgCAMA0GCCqGSIb3DQMC AgFAMAcGBSsOAwIHMA0GCCqGSIb3DQMCAgEoMA0GCSqGSIb3DQEBAQUABIIC ADE5F11UmBOHjc8xe3GSy3ugvFCq2q9YSRry4ARNyp32rj76dLKoEPj3Gm/j X9wi6zfcbI61t17iVY2NOKgqi0MFZiEsAbpa3CATR86MzCV3yd9ozXKA6+bI kkpGnKkTUlEMUMCXfQ0FG6dISODa3A8qZAD7Vd/mrH9lvJIxCswMMOVXxpgq 5ZFtrgCdW0+hqrNCJwchomTyAPVOzRCFDMoqpuYrWPcFNlHCYTlHmU+NBh+T Za8wiJKZFWAuN/7PLy5dh2iMnrU20X/TEDVKhLdfSv+I5hAP1jX1rA6wW3zE TlMr7EZ2s4Z22g7kYXBdJTez0mFRy4PP71OV8RvDlaZxtx+iVz+s8VYQGXB6 94TfcNs7SrkEols21/9qMwgVM0VhI9gH+pO8DTWpUJZPkYknvZe/DENgtM1i ECAS7MmyliD33i2J+JXrf4xcWn6M8oQh/E2tFOT5Pey4Q/3Uw4zQLEl38fft +uCUkzSPwSqyBvRV60iTjMjAOB+cI+dqrE+i6DtGAc4AAIujIwL+goXJP63a Jt8dKgUWMOlX66GqAYOfPU9I4yk2URKE8v3Nw0STyQ9Rwqxie8B7cpVNrir+ pFdwKZj1YBMt1Bvjf/zLR6zMKxYHzoC44JuCSKdWjxB2mkg2r8LBkx38Z4vc 2XuBZ+/TKju4CUshUO8esFHX --1563967779-593110539-1571176425=:87688-- From owner-freebsd-xen@freebsd.org Tue Oct 15 22:10:24 2019 Return-Path: Delivered-To: freebsd-xen@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id B1E3A155B83 for ; Tue, 15 Oct 2019 22:10:24 +0000 (UTC) (envelope-from sparvu@kronometrix.org) Received: from mail.kronometrix.org (mail.kronometrix.org [95.85.46.90]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mail.kronometrix.org", Issuer "mail.kronometrix.org" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 46t8kR65Ddz3QsF for ; Tue, 15 Oct 2019 22:10:23 +0000 (UTC) (envelope-from sparvu@kronometrix.org) Received: from [192.168.1.191] (82-203-142-243.bb.dnainternet.fi [82.203.142.243]) (authenticated bits=0) by mail.kronometrix.org (8.15.2/8.15.2) with ESMTPSA id x9FMAKQA081830 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Tue, 15 Oct 2019 22:10:21 GMT (envelope-from sparvu@kronometrix.org) X-Authentication-Warning: mail.kronometrix.org: Host 82-203-142-243.bb.dnainternet.fi [82.203.142.243] claimed to be [192.168.1.191] From: Stefan Parvu Message-Id: <75CEEEC9-E1E3-4472-BDBF-DDDB96696854@kronometrix.org> Mime-Version: 1.0 (Mac OS X Mail 12.4 \(3445.104.11\)) Subject: Re: cannot install FreeBSD 12.0 Xen 4.12.1 on Intel Core i7 CPU 930 Date: Wed, 16 Oct 2019 01:10:14 +0300 In-Reply-To: Cc: freebsd-xen@freebsd.org To: Marcin Cieslak References: X-Mailer: Apple Mail (2.3445.104.11) X-Rspamd-Queue-Id: 46t8kR65Ddz3QsF X-Spamd-Bar: +++ Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of sparvu@kronometrix.org designates 95.85.46.90 as permitted sender) smtp.mailfrom=sparvu@kronometrix.org X-Spamd-Result: default: False [3.69 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; MV_CASE(0.50)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; HAS_XAW(0.00)[]; DMARC_NA(0.00)[kronometrix.org]; NEURAL_SPAM_MEDIUM(0.98)[0.976,0]; URI_COUNT_ODD(1.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_SPAM_LONG(0.88)[0.882,0]; IP_SCORE(0.64)[ip: (0.46), ipnet: 95.85.0.0/18(1.06), asn: 14061(1.71), country: US(-0.05)]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:14061, ipnet:95.85.0.0/18, country:US]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 15 Oct 2019 22:10:24 -0000 >=20 > Does it happen in Xen or in FreeBSD dom0 kernel? Xen. Here: http://www.kronometrix.org/bugs/freebsd_xen.jpg > I have Xeon E3-1234 but I run 11.2-STABLE with xen-kernel-4.7.2_9 for = a very long time already. > I also have: >=20 > hw.pci.mcfg=3D0 > machdep.hyperthreading_allowed=3D0 Should I add these to sysctl.conf ? I will try tomorrow. To me it looks = whatever I try I cannot get IOMMU on this hdw with FreeBSD 12 and Xen 4.12.1. I havent tried = another FreeBSD version. Previously this box was running Ubuntu 16.x and KVM with no problems. Stefan= From owner-freebsd-xen@freebsd.org Tue Oct 15 22:22:02 2019 Return-Path: Delivered-To: freebsd-xen@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 81BB61561CC for ; Tue, 15 Oct 2019 22:22:02 +0000 (UTC) (envelope-from saper@saper.info) Received: from m.saper.info (m.saper.info [IPv6:2a01:4f8:a0:7383::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "saper.info", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 46t8zs5LXRz3wlk for ; Tue, 15 Oct 2019 22:22:01 +0000 (UTC) (envelope-from saper@saper.info) Received: from m.saper.info (saper@m.saper.info [IPv6:2a01:4f8:a0:7383:0:0:0:0]) by m.saper.info (8.15.2/8.15.2) with ESMTPS id x9FMLxQq019334 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Tue, 15 Oct 2019 22:22:00 GMT (envelope-from saper@saper.info) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=saper.info; s=Sep2014; t=1571178120; bh=1/l1buPhKQ+o9/co0y8pNHBV41C4ajuguf4hYt6xCL0=; h=Date:From:To:cc:Subject:In-Reply-To:References; b=GcJOyWf87Dua0J227VoiQEHipShAB5zlXEaJItYlcIhnSRxGZbTc1VJXfflegckhq QmMPte+AlTJUSl3FeffXj6PgfL1ndX9BEiRHxuT1KPkcFAu1IWiUmi4tabpLSQjjaN fk+UZwWnUDtX5meNzwBjcSad1z1ps0AxhMF1YfPQ= Received: from localhost (saper@localhost) by m.saper.info (8.15.2/8.15.2/Submit) with ESMTP id x9FMLxKa019331; Tue, 15 Oct 2019 22:21:59 GMT (envelope-from saper@saper.info) X-Authentication-Warning: m.saper.info: saper owned process doing -bs Date: Tue, 15 Oct 2019 22:21:59 +0000 From: Marcin Cieslak To: Stefan Parvu cc: freebsd-xen@freebsd.org Subject: Re: cannot install FreeBSD 12.0 Xen 4.12.1 on Intel Core i7 CPU 930 In-Reply-To: <75CEEEC9-E1E3-4472-BDBF-DDDB96696854@kronometrix.org> Message-ID: References: <75CEEEC9-E1E3-4472-BDBF-DDDB96696854@kronometrix.org> MIME-Version: 1.0 Content-Type: multipart/signed; protocol="application/pkcs7-signature"; micalg=sha-256; boundary="1563967779-2085296904-1571178119=:87688" X-Rspamd-Queue-Id: 46t8zs5LXRz3wlk X-Spamd-Bar: ------- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=saper.info header.s=Sep2014 header.b=GcJOyWf8; dmarc=none; spf=none (mx1.freebsd.org: domain of saper@saper.info has no SPF policy when checking 2a01:4f8:a0:7383::) smtp.mailfrom=saper@saper.info X-Spamd-Result: default: False [-7.14 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[saper.info:s=Sep2014]; FROM_HAS_DN(0.00)[]; SIGNED_SMIME(-2.00)[]; TO_DN_SOME(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; HAS_ATTACHMENT(0.00)[]; HAS_XAW(0.00)[]; DMARC_NA(0.00)[saper.info]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[saper.info:+]; RCPT_COUNT_TWO(0.00)[2]; R_SPF_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:24940, ipnet:2a01:4f8::/29, country:DE]; RCVD_COUNT_TWO(0.00)[2]; IP_SCORE(-2.74)[ip: (-9.81), ipnet: 2a01:4f8::/29(-2.10), asn: 24940(-1.81), country: DE(-0.01)] X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 15 Oct 2019 22:22:02 -0000 --1563967779-2085296904-1571178119=:87688 Content-Type: text/plain; format=flowed; charset=US-ASCII On Wed, 16 Oct 2019, Stefan Parvu wrote: >> >> Does it happen in Xen or in FreeBSD dom0 kernel? > > Xen. Here: > http://www.kronometrix.org/bugs/freebsd_xen.jpg > >> I have Xeon E3-1234 but I run 11.2-STABLE with xen-kernel-4.7.2_9 for a very long time already. >> I also have: >> >> hw.pci.mcfg=0 >> machdep.hyperthreading_allowed=0 > > Should I add these to sysctl.conf ? I will try tomorrow. To me it looks whatever I try I cannot > get IOMMU on this hdw with FreeBSD 12 and Xen 4.12.1. I havent tried another FreeBSD version. No idea, just showing what I have. Maybe totally not relevant to what you are having - I am going to try 12 and Xen 4.12.1 soon. I also don't have "iommu=required,force" in my Xen commandline: "dom0_mem=4096M dom0_max_vcpus=1 dom0pvh=1 com1=115200,8n1 guest_loglvl=all loglvl=all vga=text-80x43,keep console=vga" --1563967779-2085296904-1571178119=:87688 Content-Type: application/pkcs7-signature; name=smime.p7s Content-Transfer-Encoding: BASE64 Content-Description: S/MIME Cryptographic Signature Content-Disposition: attachment; filename=smime.p7s MIIOSwYJKoZIhvcNAQcCoIIOPDCCDjgCAQExDzANBglghkgBZQMEAgEFADAL BgkqhkiG9w0BBwGgggqQMIIElzCCA3+gAwIBAgIOSBtqCKJEiNNcmz3JSA0w DQYJKoZIhvcNAQELBQAwTDEgMB4GA1UECxMXR2xvYmFsU2lnbiBSb290IENB IC0gUjMxEzARBgNVBAoTCkdsb2JhbFNpZ24xEzARBgNVBAMTCkdsb2JhbFNp Z24wHhcNMTYwNjE1MDAwMDAwWhcNMjQwNjE1MDAwMDAwWjBdMQswCQYDVQQG EwJCRTEZMBcGA1UEChMQR2xvYmFsU2lnbiBudi1zYTEzMDEGA1UEAxMqR2xv YmFsU2lnbiBQZXJzb25hbFNpZ24gMSBDQSAtIFNIQTI1NiAtIEczMIIBIjAN BgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAyrCba00KOKyGuwh9h+/MAcZm ZUF9OxGKA56AADHaDE08rB0WEbgm6J4XvJP3OGQ7cgHdVJu6XMZkRd6EcfjD yRrIwE6oAVWJe57co3gKk/XxvuubSZuUahrcOiv3D2qaHwva4zumubxQQI4f unEzRIJHPiNjaq0cCcZsMcp5pxsEz8aG0sr8Oh80sxKNnzPmuUETLESktfMC pQKHUGmWXLsG6sgCZOezUjDjKpPKW7l4PUt0TEBEyqLhifv9/YPn5C4o10PP daDazZPeKNif2PVQ5u0HRnkFrHh4wmmrMtY22Mse3eR01gD6rEEGWf+gdzuy EQE+ZVlNhCP4gXjdBQIDAQABo4IBZDCCAWAwDgYDVR0PAQH/BAQDAgEGMCcG A1UdJQQgMB4GCCsGAQUFBwMCBggrBgEFBQcDBAYIKwYBBQUHAwkwEgYDVR0T AQH/BAgwBgEB/wIBADAdBgNVHQ4EFgQUlifCwqX3HPgCenpkr2NvMtKYwrEw HwYDVR0jBBgwFoAUj/BLf6guRSSuTVD6Y5qL3uLdG7wwPgYIKwYBBQUHAQEE MjAwMC4GCCsGAQUFBzABhiJodHRwOi8vb2NzcDIuZ2xvYmFsc2lnbi5jb20v cm9vdHIzMDYGA1UdHwQvMC0wK6ApoCeGJWh0dHA6Ly9jcmwuZ2xvYmFsc2ln bi5jb20vcm9vdC1yMy5jcmwwWQYDVR0gBFIwUDALBgkrBgEEAaAyASgwQQYJ KwYBBAGgMgFfMDQwMgYIKwYBBQUHAgEWJmh0dHBzOi8vd3d3Lmdsb2JhbHNp Z24uY29tL3JlcG9zaXRvcnkvMA0GCSqGSIb3DQEBCwUAA4IBAQCxh3ekjKKy RrUdfI6D1U7qUggdFLksiU+KiIqJzJG6GXcQ2KiBy2tF3+KYb0IixXMpIVli VXlcD5Vh4tiMxJ4WONMFt3f7/53gSXLf24WMwErubc+mGMzgUGE5HKC98PcK UV/5pPggQdzPxCBNeiXnLU1tCGYhPatFTDhUBGaVhBeuUCbgR9gpXJ9guqrD OVwouKvovdIeI5KEAcoAAiSL6naeLk/GbKUaBFa2RxXC17e+YyBWtWlWDEM3 1V8pUIx76lkO8IJYREhLcg/LnyoYy5wcrzI6pbX2vw1x/jR3GHSC1AEdoqbE xui2XLLlSa6y9yQNgdkPz7GTLmpwIT+dMIIF8TCCBNmgAwIBAgIMGk4Oe/1h 2+wMOby/MA0GCSqGSIb3DQEBCwUAMF0xCzAJBgNVBAYTAkJFMRkwFwYDVQQK ExBHbG9iYWxTaWduIG52LXNhMTMwMQYDVQQDEypHbG9iYWxTaWduIFBlcnNv bmFsU2lnbiAxIENBIC0gU0hBMjU2IC0gRzMwHhcNMTcwNTI1MDg0NDE2WhcN MjAwNTI1MDg0NDE2WjA8MRkwFwYDVQQDDBBzYXBlckBzYXBlci5pbmZvMR8w HQYJKoZIhvcNAQkBFhBzYXBlckBzYXBlci5pbmZvMIICIjANBgkqhkiG9w0B AQEFAAOCAg8AMIICCgKCAgEA2sO3aQNus/oe4ZBZ4fu1Y1mzxnUYAkb4k/dw gMFc2Kd0eRoOY0AHj4rTEi/vVzzizxjLbEwXzQ9cBEAu/PqS8WsOmhZXtlfi szPDmP7ZpOwmNTWKSd9O7jHu9uTCGfEOsocQNYH2ULD1gVFkgKb8jHf+3u9d uCzh6qMomTtwLrCGEP70Lq385xUzRaD6qbOeIB99tpzgvMR6Z0GPTt4z8tLM kfdtohq5llwZ5vYnj/hJohVS9iLMQMHW4nuLj/mLZNaYE1CWJBT1rBwn5YPJ uR6811O9eAP7aX4iG8k1jkiBh+QNgGRBIK4GIdqy7IVRhA7v2OlpLYHMk4zP 9Fs3M+56QromVKBnxfzLhuYMUK6ugj9jwskNVitqlEFUeyfgvmR1jnPRp1Nd XGJllTNwGicR8wkaRj14RxfrvTZfwXs8OBODKFupqun/tNzdpOgyHMGQACss 9yv2SnLGCJvJK3rGIdRZEiUhLZH/Ct4L92dBhev+SjUqWKbHb4yIlGMgLdoh nwqatuWw7iyOeInjcinX7ghiIKDWhulUN493Fzl6kaUBtIIcrb7jzZ2pHAQT WUmuVnCTHk6NtoWB09lvuK77fw4GfxLWDFWkBQiJYPVBrmxlrkCKzrWdTMfS W9BiEC10jT1sSimUBIjDz22RkfsApeBJoAIWjiOZogILu9MCAwEAAaOCAdAw ggHMMA4GA1UdDwEB/wQEAwIFoDCBngYIKwYBBQUHAQEEgZEwgY4wTQYIKwYB BQUHMAKGQWh0dHA6Ly9zZWN1cmUuZ2xvYmFsc2lnbi5jb20vY2FjZXJ0L2dz cGVyc29uYWxzaWduMXNoYTJnM29jc3AuY3J0MD0GCCsGAQUFBzABhjFodHRw Oi8vb2NzcDIuZ2xvYmFsc2lnbi5jb20vZ3NwZXJzb25hbHNpZ24xc2hhMmcz MEwGA1UdIARFMEMwQQYJKwYBBAGgMgEoMDQwMgYIKwYBBQUHAgEWJmh0dHBz Oi8vd3d3Lmdsb2JhbHNpZ24uY29tL3JlcG9zaXRvcnkvMAkGA1UdEwQCMAAw RAYDVR0fBD0wOzA5oDegNYYzaHR0cDovL2NybC5nbG9iYWxzaWduLmNvbS9n c3BlcnNvbmFsc2lnbjFzaGEyZzMuY3JsMBsGA1UdEQQUMBKBEHNhcGVyQHNh cGVyLmluZm8wHQYDVR0lBBYwFAYIKwYBBQUHAwIGCCsGAQUFBwMEMB0GA1Ud DgQWBBReBINaGUKUo7HCrIjsKLKERu6ooTAfBgNVHSMEGDAWgBSWJ8LCpfcc +AJ6emSvY28y0pjCsTANBgkqhkiG9w0BAQsFAAOCAQEAC0VK968ySq/6B+Kd ecjVThQOKtVXuG17Krfk0xz7OPYR/V+qZtBFm2Uc6tkUEmAmq3Tyf+SE3TTX Q58eJFq0uCTUhIY714ioJs1uVWBz8rPyJ3swkOfDaUXUxkQsBsf73VfKjUk4 kB5MTrApLYUe35NmEY3FqyyX13elhW1tp864vOKM2Git61cYoRn/bwd/z2JM Zkxwkd5JgvmM+p4Da+WO4CUsGzdrZEH8X/8NQIzWtUDIh7VEQZFX5fot/KvH Am8AajtpmNqTfMyg6LfcfJUXSFqXn/KEWu4Td62vX6Pd70dYKUZxnLwYvGqG A4Ktrp9zyrUzxLbmdaPln7CstjGCA38wggN7AgEBMG0wXTELMAkGA1UEBhMC QkUxGTAXBgNVBAoTEEdsb2JhbFNpZ24gbnYtc2ExMzAxBgNVBAMTKkdsb2Jh bFNpZ24gUGVyc29uYWxTaWduIDEgQ0EgLSBTSEEyNTYgLSBHMwIMGk4Oe/1h 2+wMOby/MA0GCWCGSAFlAwQCAQUAoIHkMBgGCSqGSIb3DQEJAzELBgkqhkiG 9w0BBwEwHAYJKoZIhvcNAQkFMQ8XDTE5MTAxNTIyMjE1OVowLwYJKoZIhvcN AQkEMSIEII2/9SCdz9+nQRA+2W7OA1poQkcgH9D05EYy9HU4CkbJMHkGCSqG SIb3DQEJDzFsMGowCwYJYIZIAWUDBAEqMAsGCWCGSAFlAwQBFjALBglghkgB ZQMEAQIwCgYIKoZIhvcNAwcwDgYIKoZIhvcNAwICAgCAMA0GCCqGSIb3DQMC AgFAMAcGBSsOAwIHMA0GCCqGSIb3DQMCAgEoMA0GCSqGSIb3DQEBAQUABIIC ACg+QlgvFtUPd78unD2XLefQuFMwF+8kD99hRdOewyIiiM8wnJTf/vlWJAaX pIcTXnrq7h4zIbpcczeRwQ02tRtirJU+GfuLivhSmfBoQ/GN+GfbGao9SIQZ lmwemMe41cB8xfFV50zxFcx+aGUfvPHCl8ZKj12ndR1LstItuMcoO5le+IwN AzbGKcFkBWJIgXCIjbzXkXTsWQWUcDXGHY5hMJWroak+HMyXi5aNp7e9sibs LawyLsA6MYHn/soHLFzyjDZsfgPUlmHBshhGLuicwEpUmXfeL5gwkYuPsgJH Y6T3Bc+2zs3BBS0C2tKJTx2PCcOIGNGMFxp52gmPUYlgSehljF/epjh3+d1k flxG7XTYzUVa1BZ+yowUiEXWxxMWDjPeW9y2vvJzOeFKtIUBr+88aOZh7oPm O8LIveF8/it7hEjrmAFOZUH8hQ9VcqExr8499/lXDzkPIUiyIZT7pWR0BIq2 /SAo9b2Q/leMgdztR6XIRkUIqpicScWswnjV2LJTqwV6cU+QGTHmCjS8rHJX 3N8u+KoqbbhPZ8FxAf8x0UFBHwwG3p/bHHd2KHq2j8YohG87vKu03gxCTCdq p8enzrp0lkdM34IisGtq8enJhmaE1jhHmD1G9b9fw15gChm5ZMqYZMZseVED LFkm0LBy+aYvqIzNfQupe4YV --1563967779-2085296904-1571178119=:87688-- From owner-freebsd-xen@freebsd.org Wed Oct 16 08:36:54 2019 Return-Path: Delivered-To: freebsd-xen@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 71EE515F5B7 for ; Wed, 16 Oct 2019 08:36:54 +0000 (UTC) (envelope-from royger@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 46tQdL2NqHz4Rvn; Wed, 16 Oct 2019 08:36:54 +0000 (UTC) (envelope-from royger@freebsd.org) Received: from localhost (unknown [212.230.157.24]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) (Authenticated sender: royger) by smtp.freebsd.org (Postfix) with ESMTPSA id CCFB91B3B0; Wed, 16 Oct 2019 08:36:53 +0000 (UTC) (envelope-from royger@freebsd.org) Date: Wed, 16 Oct 2019 10:36:46 +0200 From: Roger Pau =?iso-8859-1?Q?Monn=E9?= To: Brian Buhrow Cc: freebsd-xen@freebsd.org Subject: Re: i/o is very slow on FreeBSD dom0 with Xen-4.12 and Freebsd-12 Message-ID: <20191016083646.GC14005@Air-de-Roger> References: <20191015082655.GB14005@Air-de-Roger> <201910151556.x9FFuNUA011130@lothlorien.nfbcal.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <201910151556.x9FFuNUA011130@lothlorien.nfbcal.org> User-Agent: Mutt/1.12.2 (2019-09-21) X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Oct 2019 08:36:54 -0000 On Tue, Oct 15, 2019 at 08:56:22AM -0700, Brian Buhrow wrote: > hello Roger. Sorry, my bad. I didn't even look at the cause of the > panic. Rebooting the system caused it to come up clean after another pass > with fsck. With the ioapic_ack=old argument, the system comes up right > away and is quite responsive. > Can you explain how to select which argument to use on the command > line if the autoselection code doesn't work? Hm, it's not so much that the autodetection is wrong, AFAIK there's some hardware issue with specific models that make the new ack method not work properly. This is limited to very specific (and older) models. Note that you might still see interrupt timeouts with the old ack method. I will try to figure out if there's any hardware errata that could be related to this issue, and try to find a box to reproduce (this might not be feasible since I'm not sure I have anything similar to your hardware available). Roger. From owner-freebsd-xen@freebsd.org Wed Oct 16 08:41:02 2019 Return-Path: Delivered-To: freebsd-xen@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id DE78F15F7BB for ; Wed, 16 Oct 2019 08:41:02 +0000 (UTC) (envelope-from roger.pau@citrix.com) Received: from esa3.hc3370-68.iphmx.com (esa3.hc3370-68.iphmx.com [216.71.145.155]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "esa3.hc3370-68.iphmx.com", Issuer "HydrantID SSL ICA G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 46tQk563d0z4S3T for ; Wed, 16 Oct 2019 08:41:01 +0000 (UTC) (envelope-from roger.pau@citrix.com) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=citrix.com; s=securemail; t=1571215262; h=date:from:to:cc:subject:message-id:references: mime-version:content-transfer-encoding:in-reply-to; bh=O+0lLB+R7Ev+1jT6sBfhiFkUcCphRF4QLmbFhZALf2s=; b=KcEcFM9meBNO31eCB85h5HSZ+nxa/JHXXpUD2cSFFFdWAdw6ci8DbH8k kg5W3oXKKEmLiOSGUuJaPTst5N7yl5XvwUarty+N9JFyuYyThfl0sEpzO 7Mi92UWUoVXjR5W4ymfmvgWgwtLkZb+ss7HG36XiIL0s32qjFHgDRXmBm o=; Received-SPF: None (esa3.hc3370-68.iphmx.com: no sender authenticity information available from domain of roger.pau@citrix.com) identity=pra; client-ip=162.221.158.21; receiver=esa3.hc3370-68.iphmx.com; envelope-from="roger.pau@citrix.com"; x-sender="roger.pau@citrix.com"; x-conformance=sidf_compatible Received-SPF: Pass (esa3.hc3370-68.iphmx.com: domain of roger.pau@citrix.com designates 162.221.158.21 as permitted sender) identity=mailfrom; client-ip=162.221.158.21; receiver=esa3.hc3370-68.iphmx.com; envelope-from="roger.pau@citrix.com"; x-sender="roger.pau@citrix.com"; x-conformance=sidf_compatible; x-record-type="v=spf1"; x-record-text="v=spf1 ip4:209.167.231.154 ip4:178.63.86.133 ip4:195.66.111.40/30 ip4:85.115.9.32/28 ip4:199.102.83.4 ip4:192.28.146.160 ip4:192.28.146.107 ip4:216.52.6.88 ip4:216.52.6.188 ip4:162.221.158.21 ip4:162.221.156.83 ip4:168.245.78.127 ~all" Received-SPF: None (esa3.hc3370-68.iphmx.com: no sender authenticity information available from domain of postmaster@mail.citrix.com) identity=helo; client-ip=162.221.158.21; receiver=esa3.hc3370-68.iphmx.com; envelope-from="roger.pau@citrix.com"; x-sender="postmaster@mail.citrix.com"; x-conformance=sidf_compatible IronPort-SDR: g0syXpoW770m4r19mFvl/tYllbMO/mc39yT/4PtIWgpBfdX+FbK2ZznE1fjuPnwt8VN4cgg5D4 UZA8LAhVngUsC/R1TcDO+qyJjUMgr4LsVVyUfywRIoWKRbpp9lM8ra9u+L5HwJvKRfPm3RnSvu Mcis11ocWMGgfzyEy8VvjnehmTCkzFPaHQRhsXB2zgIR/YAmgoYbM3rtqfIyxdPx05y7gIrenX Q2n0F/cR/wOQonnBSowywKHgRFuSJGgTkmAt4EQg/RWgrFjGaUmZuks/mQO6u5RLK9f0Iew5it oVU= X-SBRS: 2.7 X-MesageID: 6945214 X-Ironport-Server: esa3.hc3370-68.iphmx.com X-Remote-IP: 162.221.158.21 X-Policy: $RELAYED X-IronPort-AV: E=Sophos;i="5.67,303,1566878400"; d="scan'208";a="6945214" Date: Wed, 16 Oct 2019 10:40:50 +0200 From: Roger Pau =?iso-8859-1?Q?Monn=E9?= To: Stefan Parvu CC: Subject: Re: cannot install FreeBSD 12.0 Xen 4.12.1 on Intel Core i7 CPU 930 Message-ID: <20191016084050.GD14005@Air-de-Roger> References: MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: User-Agent: Mutt/1.12.2 (2019-09-21) X-ClientProxiedBy: AMSPEX02CAS01.citrite.net (10.69.22.112) To AMSPEX02CL02.citrite.net (10.69.22.126) X-Rspamd-Queue-Id: 46tQk563d0z4S3T X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=citrix.com header.s=securemail header.b=KcEcFM9m; dmarc=pass (policy=none) header.from=citrix.com; spf=pass (mx1.freebsd.org: domain of roger.pau@citrix.com designates 216.71.145.155 as permitted sender) smtp.mailfrom=roger.pau@citrix.com X-Spamd-Result: default: False [-4.72 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[citrix.com:s=securemail]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; RCVD_DKIM_ARC_DNSWL_MED(-0.50)[]; DWL_DNSWL_LOW(-1.00)[citrix.com.dwl.dnswl.org : 127.0.9.1]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_MED(-0.20)[155.145.71.216.list.dnswl.org : 127.0.3.2]; DKIM_TRACE(0.00)[citrix.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[citrix.com,none]; RCVD_COUNT_ZERO(0.00)[0]; FROM_EQ_ENVFROM(0.00)[]; MID_RHS_NOT_FQDN(0.50)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:16417, ipnet:216.71.145.0/24, country:US]; IP_SCORE(-0.52)[ipnet: 216.71.145.0/24(-1.25), asn: 16417(-1.33), country: US(-0.05)] X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Oct 2019 08:41:02 -0000 On Wed, Oct 16, 2019 at 12:12:06AM +0300, Stefan Parvu wrote: > Hi, > > I have a bit of problem, cannot install FreeBSD/Xen on a bit older hardware. The hardware > should support the minimal VT-D/IOMMU settings, required by Xen. > > CPU: Intel(R) Core(TM) i7 CPU 930 @ 2.80GHz (2806.42-MHz K8-class CPU) > Origin="GenuineIntel" Id=0x106a5 Family=0x6 Model=0x1a Stepping=5 > Features=0xbfebfbff > Features2=0x98e3bd > AMD Features=0x28100800 > AMD Features2=0x1 > VT-x: PAT,HLT,MTF,PAUSE,EPT,VPID > TSC: P-state invariant, performance statistics > > I get always a panic on CPU0 followed by a reboot. My /boot/loader.conf was set as: > > xen_cmdline="dom0_mem=2048M dom0_max_vcpus=4 dom0=pvh console=com1,vga com1=115200,8n1 guest_loglvl=all loglvl=all iommu=debug,force” > > Any ideas what I could try ? Hello, Can you please provide the full boot log? I'm afraid that I'm not able to provide any suggestions without knowing what went wrong. Thanks, Roger. From owner-freebsd-xen@freebsd.org Wed Oct 16 08:50:05 2019 Return-Path: Delivered-To: freebsd-xen@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 2294215F89A for ; Wed, 16 Oct 2019 08:50:05 +0000 (UTC) (envelope-from sparvu@kronometrix.org) Received: from mail.kronometrix.org (mail.kronometrix.org [95.85.46.90]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mail.kronometrix.org", Issuer "mail.kronometrix.org" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 46tQwX0SFNz4SRx for ; Wed, 16 Oct 2019 08:50:03 +0000 (UTC) (envelope-from sparvu@kronometrix.org) Received: from [192.168.1.191] (82-203-142-243.bb.dnainternet.fi [82.203.142.243]) (authenticated bits=0) by mail.kronometrix.org (8.15.2/8.15.2) with ESMTPSA id x9G8nu80086387 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Wed, 16 Oct 2019 08:49:57 GMT (envelope-from sparvu@kronometrix.org) X-Authentication-Warning: mail.kronometrix.org: Host 82-203-142-243.bb.dnainternet.fi [82.203.142.243] claimed to be [192.168.1.191] Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 12.4 \(3445.104.11\)) Subject: Re: cannot install FreeBSD 12.0 Xen 4.12.1 on Intel Core i7 CPU 930 From: Stefan Parvu In-Reply-To: <20191016084050.GD14005@Air-de-Roger> Date: Wed, 16 Oct 2019 11:49:50 +0300 Cc: freebsd-xen@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <4D6CBDA5-711B-4501-AFC1-A41D1134EF73@kronometrix.org> References: <20191016084050.GD14005@Air-de-Roger> To: =?utf-8?Q?Roger_Pau_Monn=C3=A9?= X-Mailer: Apple Mail (2.3445.104.11) X-Rspamd-Queue-Id: 46tQwX0SFNz4SRx X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of sparvu@kronometrix.org designates 95.85.46.90 as permitted sender) smtp.mailfrom=sparvu@kronometrix.org X-Spamd-Result: default: False [-0.14 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; NEURAL_HAM_MEDIUM(-0.02)[-0.015,0]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; MV_CASE(0.50)[]; MIME_GOOD(-0.10)[text/plain]; HAS_XAW(0.00)[]; DMARC_NA(0.00)[kronometrix.org]; NEURAL_HAM_LONG(-0.96)[-0.959,0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; IP_SCORE(0.63)[ip: (0.45), ipnet: 95.85.0.0/18(1.05), asn: 14061(1.72), country: US(-0.05)]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:14061, ipnet:95.85.0.0/18, country:US]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Oct 2019 08:50:05 -0000 > Can you please provide the full boot log? I'm afraid that I'm not able > to provide any suggestions without knowing what went wrong. In BIOS everything regarding virtualization is turned ON. How can I provide the full boot log if my machine is rebooting itself = =E2=80=A6=20 and have no access to the files? Im not able to control how can I boot = again. I usually need to reinstall everything from scratch.=20 Is there any way to configure the boot loader and boot with or without = Xen kernel ? Many thanks, Stefan= From owner-freebsd-xen@freebsd.org Wed Oct 16 09:00:32 2019 Return-Path: Delivered-To: freebsd-xen@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 0952E15FD4D for ; Wed, 16 Oct 2019 09:00:32 +0000 (UTC) (envelope-from roger.pau@citrix.com) Received: from esa6.hc3370-68.iphmx.com (esa6.hc3370-68.iphmx.com [216.71.155.175]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "esa6.hc3370-68.iphmx.com", Issuer "HydrantID SSL ICA G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 46tR8b0xwpz4T5b for ; Wed, 16 Oct 2019 09:00:30 +0000 (UTC) (envelope-from roger.pau@citrix.com) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=citrix.com; s=securemail; t=1571216431; h=date:from:to:cc:subject:message-id:references: mime-version:content-transfer-encoding:in-reply-to; bh=6Ijx9L197dbBiPL9xnWcJu4lmiCCbdIccsR3Stu/J0U=; b=NKG2qBfI1rQd7mR56U4WkeBe+tI65EAGakp0ozJWOVRcXC6oFU9Bw0Oq OP9jvrxeXF1YkOSytvfh8JGoZiIP1d/YOkss/5QgbYkkYX7uGIw9cLXj2 PJgV5T7oIGUwK+yuj7UWok1KPsTZrHBbbtstOVZqtu9dbn2JD87oJNizx 8=; Received-SPF: None (esa6.hc3370-68.iphmx.com: no sender authenticity information available from domain of roger.pau@citrix.com) identity=pra; client-ip=162.221.158.21; receiver=esa6.hc3370-68.iphmx.com; envelope-from="roger.pau@citrix.com"; x-sender="roger.pau@citrix.com"; x-conformance=sidf_compatible Received-SPF: Pass (esa6.hc3370-68.iphmx.com: domain of roger.pau@citrix.com designates 162.221.158.21 as permitted sender) identity=mailfrom; client-ip=162.221.158.21; receiver=esa6.hc3370-68.iphmx.com; envelope-from="roger.pau@citrix.com"; x-sender="roger.pau@citrix.com"; x-conformance=sidf_compatible; x-record-type="v=spf1"; x-record-text="v=spf1 ip4:209.167.231.154 ip4:178.63.86.133 ip4:195.66.111.40/30 ip4:85.115.9.32/28 ip4:199.102.83.4 ip4:192.28.146.160 ip4:192.28.146.107 ip4:216.52.6.88 ip4:216.52.6.188 ip4:162.221.158.21 ip4:162.221.156.83 ip4:168.245.78.127 ~all" Received-SPF: None (esa6.hc3370-68.iphmx.com: no sender authenticity information available from domain of postmaster@mail.citrix.com) identity=helo; client-ip=162.221.158.21; receiver=esa6.hc3370-68.iphmx.com; envelope-from="roger.pau@citrix.com"; x-sender="postmaster@mail.citrix.com"; x-conformance=sidf_compatible IronPort-SDR: YSuXANV8IYAFkPdrwMQy9qbd2wyOw+FhJPu7798/UkEKrFlm690JoDFqFbV0Nj/r0ucUdJ79FV EHu1VGxTbfUiJon52VejsGCpltA3KPUNaijlBy28uw0Q/u2AkwKalxSJfx5WtYgrhqd81l8cnj 3hng5jlZvaCYVtws8Mly/2Aw8MxVFLoze0v3zUibk6fd6hApF+8p9z8RKVAbHSjYohsUaBIbcM 63y2aj+t1G5dbeKhFLA2Jax3sOQ7tAa2cWCeHbNG/JsdliueZbasIIdmtudg27Q2cK3X0AZxE7 WZY= X-SBRS: 2.7 X-MesageID: 7269514 X-Ironport-Server: esa6.hc3370-68.iphmx.com X-Remote-IP: 162.221.158.21 X-Policy: $RELAYED X-IronPort-AV: E=Sophos;i="5.67,303,1566878400"; d="scan'208";a="7269514" Date: Wed, 16 Oct 2019 11:00:22 +0200 From: Roger Pau =?iso-8859-1?Q?Monn=E9?= To: Stefan Parvu CC: Subject: Re: cannot install FreeBSD 12.0 Xen 4.12.1 on Intel Core i7 CPU 930 Message-ID: <20191016090022.GE14005@Air-de-Roger> References: <20191016084050.GD14005@Air-de-Roger> <4D6CBDA5-711B-4501-AFC1-A41D1134EF73@kronometrix.org> MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <4D6CBDA5-711B-4501-AFC1-A41D1134EF73@kronometrix.org> User-Agent: Mutt/1.12.2 (2019-09-21) X-ClientProxiedBy: AMSPEX02CAS02.citrite.net (10.69.22.113) To AMSPEX02CL02.citrite.net (10.69.22.126) X-Rspamd-Queue-Id: 46tR8b0xwpz4T5b X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=citrix.com header.s=securemail header.b=NKG2qBfI; dmarc=pass (policy=none) header.from=citrix.com; spf=pass (mx1.freebsd.org: domain of roger.pau@citrix.com designates 216.71.155.175 as permitted sender) smtp.mailfrom=roger.pau@citrix.com X-Spamd-Result: default: False [-5.69 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[citrix.com:s=securemail]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; RCVD_DKIM_ARC_DNSWL_MED(-0.50)[]; DWL_DNSWL_LOW(-1.00)[citrix.com.dwl.dnswl.org : 127.0.9.1]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[citrix.com:+]; RCVD_IN_DNSWL_MED(-0.20)[175.155.71.216.list.dnswl.org : 127.0.3.2]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[citrix.com,none]; RCVD_COUNT_ZERO(0.00)[0]; FROM_EQ_ENVFROM(0.00)[]; MID_RHS_NOT_FQDN(0.50)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:16417, ipnet:216.71.154.0/23, country:US]; IP_SCORE(-1.49)[ip: (-3.41), ipnet: 216.71.154.0/23(-2.65), asn: 16417(-1.33), country: US(-0.05)] X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Oct 2019 09:00:32 -0000 On Wed, Oct 16, 2019 at 11:49:50AM +0300, Stefan Parvu wrote: > > Can you please provide the full boot log? I'm afraid that I'm not able > > to provide any suggestions without knowing what went wrong. > > In BIOS everything regarding virtualization is turned ON. > > How can I provide the full boot log if my machine is rebooting itself … > and have no access to the files? Im not able to control how can I boot again. > I usually need to reinstall everything from scratch. Could you setup a serial console in order to get the boot log? https://www.freebsd.org/doc/handbook/serialconsole-setup.html https://www.freebsd.org/doc/handbook/virtualization-host-xen.html If your box doesn't have a serial header, you can add noreboot to xen_cmdline and paste a photo of the screen with the panic message, it's not great but at least we would get an idea of what's wrong. > Is there any way to configure the boot loader and boot with or without Xen kernel ? Yes, when you are at the bootloader screen press '3', and then type: > unload > unset xen_kernel > boot That would make your box boot into plain FreeBSD without Xen. Roger. From owner-freebsd-xen@freebsd.org Wed Oct 16 09:08:32 2019 Return-Path: Delivered-To: freebsd-xen@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 390D915FF6C for ; Wed, 16 Oct 2019 09:08:32 +0000 (UTC) (envelope-from sparvu@kronometrix.org) Received: from mail.kronometrix.org (mail.kronometrix.org [95.85.46.90]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mail.kronometrix.org", Issuer "mail.kronometrix.org" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 46tRKq3Tjbz4TWN for ; Wed, 16 Oct 2019 09:08:31 +0000 (UTC) (envelope-from sparvu@kronometrix.org) Received: from [192.168.1.191] (82-203-142-243.bb.dnainternet.fi [82.203.142.243]) (authenticated bits=0) by mail.kronometrix.org (8.15.2/8.15.2) with ESMTPSA id x9G97tpp086518 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Wed, 16 Oct 2019 09:08:26 GMT (envelope-from sparvu@kronometrix.org) X-Authentication-Warning: mail.kronometrix.org: Host 82-203-142-243.bb.dnainternet.fi [82.203.142.243] claimed to be [192.168.1.191] From: Stefan Parvu Message-Id: <9D9848D6-2634-4777-9EE0-8DECAD2FE5CD@kronometrix.org> Mime-Version: 1.0 (Mac OS X Mail 12.4 \(3445.104.11\)) Subject: Re: cannot install FreeBSD 12.0 Xen 4.12.1 on Intel Core i7 CPU 930 Date: Wed, 16 Oct 2019 12:07:50 +0300 In-Reply-To: <20191016090022.GE14005@Air-de-Roger> Cc: freebsd-xen@freebsd.org To: =?utf-8?Q?Roger_Pau_Monn=C3=A9?= References: <20191016084050.GD14005@Air-de-Roger> <4D6CBDA5-711B-4501-AFC1-A41D1134EF73@kronometrix.org> <20191016090022.GE14005@Air-de-Roger> X-Mailer: Apple Mail (2.3445.104.11) X-Rspamd-Queue-Id: 46tRKq3Tjbz4TWN X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of sparvu@kronometrix.org designates 95.85.46.90 as permitted sender) smtp.mailfrom=sparvu@kronometrix.org X-Spamd-Result: default: False [0.94 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; MV_CASE(0.50)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; HAS_XAW(0.00)[]; DMARC_NA(0.00)[kronometrix.org]; NEURAL_SPAM_MEDIUM(0.62)[0.620,0]; NEURAL_HAM_LONG(-0.51)[-0.505,0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; IP_SCORE(0.63)[ip: (0.45), ipnet: 95.85.0.0/18(1.03), asn: 14061(1.72), country: US(-0.05)]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:14061, ipnet:95.85.0.0/18, country:US]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Oct 2019 09:08:32 -0000 > If your box doesn't have a serial header, you can add noreboot to > xen_cmdline and paste a photo of the screen with the panic message, > it's not great but at least we would get an idea of what's wrong. >=20 Im not sure I can setup a serial console on this wkst. Will check. The last thing I see is this: http://www.kronometrix.org/bugs/freebsd_xen.jpg = but nothing like a = thread dump, stack trace etc =E2=80=A6=20 But you need all boot log. I will try your option tonight. I cant access = the hardware now. > Yes, when you are at the bootloader screen press '3', and then type: >=20 >> unload >> unset xen_kernel >> boot Thats very good. Thanks.=20 Stefan= From owner-freebsd-xen@freebsd.org Wed Oct 16 09:12:39 2019 Return-Path: Delivered-To: freebsd-xen@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 5C24816016B for ; Wed, 16 Oct 2019 09:12:39 +0000 (UTC) (envelope-from roger.pau@citrix.com) Received: from esa5.hc3370-68.iphmx.com (esa5.hc3370-68.iphmx.com [216.71.155.168]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "esa5.hc3370-68.iphmx.com", Issuer "HydrantID SSL ICA G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 46tRQZ4b7xz4Txc for ; Wed, 16 Oct 2019 09:12:38 +0000 (UTC) (envelope-from roger.pau@citrix.com) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=citrix.com; s=securemail; t=1571217158; h=date:from:to:cc:subject:message-id:references: mime-version:content-transfer-encoding:in-reply-to; bh=baz6X63h/AIl/DGWe1Njxi+m/3+ywMyG/aQmVCx5JfE=; b=bJdYAdQoMaBf6eeUTi4qWidVFIKfGpWErWObNRKITCKBudod7A+h7w7x k1oIc1CqWcQ3h0yBZdpNy7U3kz6lD0q3Wr+5MHmoI72TqhB/DHNawFdy3 VopTOwcZp0mE4zifS0bDXpx0ZkvYhhyA4Jbgb+Tjmx/YLnh+3EN7Ks272 8=; Received-SPF: None (esa5.hc3370-68.iphmx.com: no sender authenticity information available from domain of roger.pau@citrix.com) identity=pra; client-ip=162.221.158.21; receiver=esa5.hc3370-68.iphmx.com; envelope-from="roger.pau@citrix.com"; x-sender="roger.pau@citrix.com"; x-conformance=sidf_compatible Received-SPF: Pass (esa5.hc3370-68.iphmx.com: domain of roger.pau@citrix.com designates 162.221.158.21 as permitted sender) identity=mailfrom; client-ip=162.221.158.21; receiver=esa5.hc3370-68.iphmx.com; envelope-from="roger.pau@citrix.com"; x-sender="roger.pau@citrix.com"; x-conformance=sidf_compatible; x-record-type="v=spf1"; x-record-text="v=spf1 ip4:209.167.231.154 ip4:178.63.86.133 ip4:195.66.111.40/30 ip4:85.115.9.32/28 ip4:199.102.83.4 ip4:192.28.146.160 ip4:192.28.146.107 ip4:216.52.6.88 ip4:216.52.6.188 ip4:162.221.158.21 ip4:162.221.156.83 ip4:168.245.78.127 ~all" Received-SPF: None (esa5.hc3370-68.iphmx.com: no sender authenticity information available from domain of postmaster@mail.citrix.com) identity=helo; client-ip=162.221.158.21; receiver=esa5.hc3370-68.iphmx.com; envelope-from="roger.pau@citrix.com"; x-sender="postmaster@mail.citrix.com"; x-conformance=sidf_compatible IronPort-SDR: sU7+I9R/Gp6pfh6VKb7Gsyx4emiAdz+1vg8BsS+5KvPQiNZ92hlpdHZANhHNBWP3Xkx/3ASwD+ 4fT5UgXUY19Tyq9fWX/X+h+UVzs9GucPIvInqoDmNyx39YsvgZ78rxlOaRj9Bspr2EJtJ+rdhn EpENL7zv+9QLcp2nCg5N5JyMuLbs6Dv0TX3YJS7fbQ2wsCLapdl2BG0Erdg5PvNU3dNRGpiyXK Ibg+bTOJ4J+PvW29TZ3IXRIGpv+KS6XgnQzlnqeQpo2OwD+38v3r8wevQgO0r8aVT6wMh4I7FJ WE0= X-SBRS: 2.7 X-MesageID: 7231076 X-Ironport-Server: esa5.hc3370-68.iphmx.com X-Remote-IP: 162.221.158.21 X-Policy: $RELAYED X-IronPort-AV: E=Sophos;i="5.67,303,1566878400"; d="scan'208";a="7231076" Date: Wed, 16 Oct 2019 11:12:30 +0200 From: Roger Pau =?iso-8859-1?Q?Monn=E9?= To: Stefan Parvu CC: Subject: Re: cannot install FreeBSD 12.0 Xen 4.12.1 on Intel Core i7 CPU 930 Message-ID: <20191016091230.GF14005@Air-de-Roger> References: <20191016084050.GD14005@Air-de-Roger> <4D6CBDA5-711B-4501-AFC1-A41D1134EF73@kronometrix.org> <20191016090022.GE14005@Air-de-Roger> <9D9848D6-2634-4777-9EE0-8DECAD2FE5CD@kronometrix.org> MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <9D9848D6-2634-4777-9EE0-8DECAD2FE5CD@kronometrix.org> User-Agent: Mutt/1.12.2 (2019-09-21) X-ClientProxiedBy: AMSPEX02CAS01.citrite.net (10.69.22.112) To AMSPEX02CL02.citrite.net (10.69.22.126) X-Rspamd-Queue-Id: 46tRQZ4b7xz4Txc X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=citrix.com header.s=securemail header.b=bJdYAdQo; dmarc=pass (policy=none) header.from=citrix.com; spf=pass (mx1.freebsd.org: domain of roger.pau@citrix.com designates 216.71.155.168 as permitted sender) smtp.mailfrom=roger.pau@citrix.com X-Spamd-Result: default: False [-6.21 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[citrix.com:s=securemail]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; RCVD_DKIM_ARC_DNSWL_MED(-0.50)[]; DWL_DNSWL_LOW(-1.00)[citrix.com.dwl.dnswl.org : 127.0.9.1]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[citrix.com:+]; RCVD_IN_DNSWL_MED(-0.20)[168.155.71.216.list.dnswl.org : 127.0.3.2]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[citrix.com,none]; RCVD_COUNT_ZERO(0.00)[0]; FROM_EQ_ENVFROM(0.00)[]; MID_RHS_NOT_FQDN(0.50)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:16417, ipnet:216.71.154.0/23, country:US]; IP_SCORE(-2.01)[ip: (-5.95), ipnet: 216.71.154.0/23(-2.70), asn: 16417(-1.33), country: US(-0.05)] X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Oct 2019 09:12:39 -0000 On Wed, Oct 16, 2019 at 12:07:50PM +0300, Stefan Parvu wrote: > > > If your box doesn't have a serial header, you can add noreboot to > > xen_cmdline and paste a photo of the screen with the panic message, > > it's not great but at least we would get an idea of what's wrong. > > > > Im not sure I can setup a serial console on this wkst. Will check. > > The last thing I see is this: > http://www.kronometrix.org/bugs/freebsd_xen.jpg but nothing like a thread dump, > stack trace etc … Your box doesn't seem to have an iommu (aka vt-d for Intel). > But you need all boot log. I will try your option tonight. I cant access the hardware now. If you can that would be helpful, but AFAIK this box is simply not capable of running a Xen PVH dom0 (which is the only mode FreeBSD supports in order to work as dom0). Either it has a broken iommu or no iommu at all. Roger. From owner-freebsd-xen@freebsd.org Wed Oct 16 09:18:01 2019 Return-Path: Delivered-To: freebsd-xen@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8458B1601EF for ; Wed, 16 Oct 2019 09:18:01 +0000 (UTC) (envelope-from sparvu@kronometrix.org) Received: from mail.kronometrix.org (mail.kronometrix.org [95.85.46.90]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mail.kronometrix.org", Issuer "mail.kronometrix.org" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 46tRXm6Blpz4V2Q for ; Wed, 16 Oct 2019 09:18:00 +0000 (UTC) (envelope-from sparvu@kronometrix.org) Received: from [192.168.1.191] (82-203-142-243.bb.dnainternet.fi [82.203.142.243]) (authenticated bits=0) by mail.kronometrix.org (8.15.2/8.15.2) with ESMTPSA id x9G9HQoQ086612 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Wed, 16 Oct 2019 09:17:56 GMT (envelope-from sparvu@kronometrix.org) X-Authentication-Warning: mail.kronometrix.org: Host 82-203-142-243.bb.dnainternet.fi [82.203.142.243] claimed to be [192.168.1.191] From: Stefan Parvu Message-Id: Mime-Version: 1.0 (Mac OS X Mail 12.4 \(3445.104.11\)) Subject: Re: cannot install FreeBSD 12.0 Xen 4.12.1 on Intel Core i7 CPU 930 Date: Wed, 16 Oct 2019 12:17:20 +0300 In-Reply-To: <20191016091230.GF14005@Air-de-Roger> Cc: freebsd-xen@freebsd.org To: =?utf-8?Q?Roger_Pau_Monn=C3=A9?= References: <20191016084050.GD14005@Air-de-Roger> <4D6CBDA5-711B-4501-AFC1-A41D1134EF73@kronometrix.org> <20191016090022.GE14005@Air-de-Roger> <9D9848D6-2634-4777-9EE0-8DECAD2FE5CD@kronometrix.org> <20191016091230.GF14005@Air-de-Roger> X-Mailer: Apple Mail (2.3445.104.11) X-Rspamd-Queue-Id: 46tRXm6Blpz4V2Q X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of sparvu@kronometrix.org designates 95.85.46.90 as permitted sender) smtp.mailfrom=sparvu@kronometrix.org X-Spamd-Result: default: False [-0.04 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; MV_CASE(0.50)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; HAS_XAW(0.00)[]; DMARC_NA(0.00)[kronometrix.org]; NEURAL_SPAM_MEDIUM(0.08)[0.082,0]; NEURAL_HAM_LONG(-0.94)[-0.944,0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; IP_SCORE(0.63)[ip: (0.44), ipnet: 95.85.0.0/18(1.02), asn: 14061(1.72), country: US(-0.05)]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:14061, ipnet:95.85.0.0/18, country:US]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Oct 2019 09:18:01 -0000 >=20 > Your box doesn't seem to have an iommu (aka vt-d for Intel). In BIOS I do have VT-D Enabled option. Would that be broken or not = working ?=20 I think I have used Xen a bit older version on Debian some time back if = Im not wrong, on the same hdw. >> But you need all boot log. I will try your option tonight. I cant = access the hardware now. >=20 > If you can that would be helpful, but AFAIK this box is simply not > capable of running a Xen PVH dom0 (which is the only mode FreeBSD > supports in order to work as dom0). Either it has a broken iommu or no > iommu at all. Hmmm. Thats strange since I do recall I had previously used here Xen but = on Linux. But older version. Could it be something changed regarding Xen and iommu or ? Stefan= From owner-freebsd-xen@freebsd.org Wed Oct 16 09:26:58 2019 Return-Path: Delivered-To: freebsd-xen@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 1869F160560 for ; Wed, 16 Oct 2019 09:26:58 +0000 (UTC) (envelope-from hafenbrack@arcor.de) Received: from vsmx012.vodafonemail.xion.oxcs.net (vsmx012.vodafonemail.xion.oxcs.net [153.92.174.90]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 46tRl465Ycz4VhW for ; Wed, 16 Oct 2019 09:26:56 +0000 (UTC) (envelope-from hafenbrack@arcor.de) Received: from vsmx004.vodafonemail.xion.oxcs.net (unknown [192.168.75.198]) by mta-8-out.mta.xion.oxcs.net (Postfix) with ESMTP id 13F8BF35A09 for ; Wed, 16 Oct 2019 09:26:54 +0000 (UTC) Received: from [192.168.178.20] (unknown [89.244.167.144]) by mta-8-out.mta.xion.oxcs.net (Postfix) with ESMTPA id D9EC319AD97 for ; Wed, 16 Oct 2019 09:26:51 +0000 (UTC) Subject: Re: cannot install FreeBSD 12.0 Xen 4.12.1 on Intel Core i7 CPU 930 Cc: freebsd-xen@freebsd.org References: <20191016084050.GD14005@Air-de-Roger> <4D6CBDA5-711B-4501-AFC1-A41D1134EF73@kronometrix.org> <20191016090022.GE14005@Air-de-Roger> <9D9848D6-2634-4777-9EE0-8DECAD2FE5CD@kronometrix.org> <20191016091230.GF14005@Air-de-Roger> From: Gerd Hafenbrack Openpgp: preference=signencrypt Autocrypt: addr=hafenbrack@arcor.de; prefer-encrypt=mutual; keydata= mQINBFXY9/ABEAC3EJBXALmbEg2fTDbufSptjwiY0gDY1OjsxjFFafhkN8NklBHIZEhXFY3n wCDfeH5NyFGhTlozwtYzOG44PLJFEoO1v0FTRaIkeX1mbL+3P6FhwPFb5Ri9JrwpqT2Wp+UO P2YAqqu+MUiBauOiaecPEbtR0Z0LTlzDFFun9HkaKoTPrrPhIk+rSaBRZ+RRf1PvzTzk4Csv wUe93dSx/cAKw2dIoi7isgdB8b4eE0QdkHm0AtRcix5AtQzMDfzJIroj6cpGio5d9kIyL4Zh ThWVBVNtC417my8ZTyjRvoi3hJYhVfh5cxjrjIJYJCtY3ZXNGS0JeM2jdj7OyK/ZsL/hThEe joo88fJAltXd25Lzxof9shFNhO70JkaKUakGXDilqEBnusAriY7UUfd6BtAvwIVDKwxJOZAH mcihCq0eD5NvQ2r+tCebR/sHKwmHRN34V91ydxFQ5LKwPZ6ZG/PZq7NdWe0dhvb2RG7r7cJ6 b4xUddnc1KmIL3hN352+RYbJWV+nvDUp3Ddblc9nVQ4Pv1vaZ+0Fy7IzSNusyyBKd32uI4Xu xgTj2EuY/kDqpgAGaDnxu3oPLS6xsZoUcta8xxxn7xjiaIWwJ1XQuBJltTkMaTBFb+mkHzKe FLhsIjbq4r1VRlMjem4mXRv3l0rcIgF+7vKN+sEx8yPz4uzxrQARAQABtCVHZXJkIEhhZmVu YnJhY2sgPGhhZmVuYnJhY2tAYXJjb3IuZGU+iQI/BBMBCAApBQJV2PfwAhsjBQkJZgGABwsJ CAcDAgEGFQgCCQoLBBYCAwECHgECF4AACgkQs2OJc3ycR41HMg/8D1CD7joH2qy0o3Dp56RZ 24KXeLsTkdNpBwv3/wKJZcZ1xThiFazJYCJGyXJo5DO/2ddW/aqRs+1KmbtVsKHCkhWGqsSJ aLw6rJcEMO+kI5JlhJUbiqQIrfcObMk8K776NGRp2QwZWix+zRLzn7wbYJNLUMxL7izS+60N GbuK/E4rZzieiq3VEYYEy01PtIjjZuEgzrJn0RYGy99v4SUix6nsp/hbBRk12mpLqKYofo/E SQ3QWXZtorVTGEk4AW7evYqwn+CjGWvdoMza6L0Hfkuf3m4XI+7hr59aszPHwJ2kCLAl+W8j 8clTnNiFkJQcP/xL2mAuNWX0wh826oPsK49VD3dkpwGWxsTx/NMF7Vl6YKcUPUQssI/TfblJ Rq1bqH01gZOHxD5JcIL56JYT2KywMW8tFHw5Wo4pfsv2TtUsD4wnNKLwnpIaGJOIaiAe5cvj uZDLZhaTVXJLD64MkpfJGymyypFUMLMvgrrzyY3ACWuqDSa+3BvhCv3weJiqlp7idmEhEy7o YYUcDoZCHumdQ3N1DxLXOI/VcxXOl392GMYCKzwQOjKHnhs1grhUv6PmbSaIB5S5XfcBnJ3N 2hv4hjiXSEV09Drk2YMTV0BG+R+TvGQzGNt4srvKBoDkh3GkMY+uVch0rT4nIwooiDOfTLtg XWRIkes6NNaF3zS5Ag0EVdj38AEQANt2Vq1QsAOPJHVjB9sH3MhnhMSYbKL2d2ZuHh02veif wZcLIXEwDWRXSdgIT4OtBhX9ob1J1p3gsEDH6SikBbllDk7+ZRsxmBD1bTmeAYLjXBXrVkT6 3VR6c3YbpRJ7bEPQHwSIRd5CEqSV1OeEg3OV/pggZ+eXCBefEEv7gEurw+dfJB9S41ID62uN 6vBxu74Ei2Q3FkbK/wmTvSik8z/A4voW/7fejc/61gdPlAwBcQMVenf5tvBTT9eG3R4C3Sm+ y5iXiCNxDUkmZKy90RRL5CJhlzG2mWT0EC1gUiPk7JkV1ii0v7giBpioJNzvWcdFt16K5Lxz 5GsDZjNfIsccRqqLeTlEF00Ub8LSagT8+DfawclQNi1+0MBDnwWkFpQaY5hiMNZrfkbdB9Yf 2SUixqXqh6gp2toXWpmeWBwfG8OBGpNQu1Np9EE0+jZq7kEy8we1eUZ5/sE/d0dFVAq0N/71 HDyFR9c5U5EumiORDlOchc3V3v2C8aluDB3cNbEZcrFsN6Kmo2vC3gjY68X3S/8Wlb6E7ESF Ko6ArwMrBnq/QMJQuW1TC3WiuyL0JSzFf4EMdPHXBdaajgZymgC7M1MECrek1rPh13WHG7VN 4Y0w+2hqcnSb08ifeJv8WFSjMajRYaC8NJKJwvc9nqbUn5YcCRP1Vr6w2Cst8jDXABEBAAGJ AiUEGAEIAA8FAlXY9/ACGwwFCQlmAYAACgkQs2OJc3ycR43FsA/8Dp47E/t4pNIOkDT/Yrgt 0ovxyFYck48XyApvzubycIqb62Gjsm9v5q7gSa6ExoQBu2q9LRm6tHYOG/my+Ykfn3v1/t+n t74C7Bd/BjbghBCB4Rpxfi3JMHllvscJZuZ4ogtD0wbIg3j4UQn28pTKzWzB/pd61n0Wq1XD Lvy625nAOuKoQkG40fl8ZlOB7PnKM7N8s8k81RMuQmR/svj/9eKIYRgGu272w3em3xlnU9dQ hTzdffYrProZ1z8XaD0RWMF0/UYaNB4KNoFR/aE9q8WT/tP5QNHsTGUi7d+I27l0FdWbWytd K2ErPzxxBPSvwVa632TfsZ98jSml5FFFR000oZcxFoVwcp06wwBTN3kQt+bMs6snZYG3pGt3 9OVY9NvyJ+9CHulM03p18i5EniJY9HLkNoLOeLZqTK173o7q2h1mm8knjS06gJXNZ9sayw4Z mrOYjj2ImZSL5IPia8QSlaxreA/b1FSiC1+U08flf0i8weR++w8Yx7AOfm5mIIENXVhV3e5n GHWMnOOPYkhgpI7ADAjzHwUWd/nz0+ynOvGPA9BfCs3EDXb0CeT7NzAfVa1gThzSlPckw5Hz IOhXQiW/qqAOQ9D3AEBeBS1o+Z7QsZWwtC+XcPIINBWG0seIB8UkE6x0xuJXLP81OnQDMk6O Dv3m8rnn9Ls/f/w= Message-ID: <3734b487-390b-bec6-90ee-5887369dad33@arcor.de> Date: Wed, 16 Oct 2019 11:26:39 +0200 User-Agent: Mozilla/5.0 (Windows NT 6.1; Win64; x64; rv:60.0) Gecko/20100101 Thunderbird/60.9.0 MIME-Version: 1.0 In-Reply-To: Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="K8CQZCbAvYz1T88CoclTj5Hlh2O8okfVr" X-VADE-STATUS: LEGIT X-Rspamd-Queue-Id: 46tRl465Ycz4VhW X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of hafenbrack@arcor.de designates 153.92.174.90 as permitted sender) smtp.mailfrom=hafenbrack@arcor.de X-Spamd-Result: default: False [-2.48 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:153.92.174.0/24]; FREEMAIL_FROM(0.00)[arcor.de]; HAS_ATTACHMENT(0.00)[]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; MISSING_TO(2.00)[]; SIGNED_PGP(-2.00)[]; FROM_EQ_ENVFROM(0.00)[]; RCVD_IN_DNSWL_LOW(-0.10)[90.174.92.153.list.dnswl.org : 127.0.5.1]; R_DKIM_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[arcor.de]; ASN(0.00)[asn:60664, ipnet:153.92.174.0/24, country:DE]; MID_RHS_MATCH_FROM(0.00)[]; RECEIVED_SPAMHAUS_PBL(0.00)[144.167.244.89.khpj7ygk5idzvmvt5x4ziurxhy.zen.dq.spamhaus.net : 127.0.0.10]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.99)[-0.986,0]; RCVD_TLS_LAST(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-0.997,0]; MIME_GOOD(-0.20)[multipart/signed,multipart/mixed,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-xen@freebsd.org]; DMARC_NA(0.00)[arcor.de]; IP_SCORE_FREEMAIL(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; MIME_TRACE(0.00)[0:+,1:+,2:+,3:~]; IP_SCORE(0.00)[asn: 60664(-2.47), country: DE(-0.01)] X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Oct 2019 09:26:58 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --K8CQZCbAvYz1T88CoclTj5Hlh2O8okfVr Content-Type: multipart/mixed; boundary="9bplo3lMfsesjReNfAtIy3bbeCHN5mbEg"; protected-headers="v1" From: Gerd Hafenbrack Cc: freebsd-xen@freebsd.org Message-ID: <3734b487-390b-bec6-90ee-5887369dad33@arcor.de> Subject: Re: cannot install FreeBSD 12.0 Xen 4.12.1 on Intel Core i7 CPU 930 References: <20191016084050.GD14005@Air-de-Roger> <4D6CBDA5-711B-4501-AFC1-A41D1134EF73@kronometrix.org> <20191016090022.GE14005@Air-de-Roger> <9D9848D6-2634-4777-9EE0-8DECAD2FE5CD@kronometrix.org> <20191016091230.GF14005@Air-de-Roger> In-Reply-To: --9bplo3lMfsesjReNfAtIy3bbeCHN5mbEg Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: quoted-printable On 2019-10-16 11:17, Stefan Parvu wrote: >> ... capable of running a Xen PVH dom0 (which is the only mode FreeBSD >> supports in order to work as dom0). Either it has a broken iommu or no= >> iommu at all. >=20 > Hmmm. Thats strange since I do recall I had previously used here Xen bu= t on Linux. But older > version. Could it be something changed regarding Xen and iommu or ? ...= You used Xen on Linux in *PVH* mode? --9bplo3lMfsesjReNfAtIy3bbeCHN5mbEg-- --K8CQZCbAvYz1T88CoclTj5Hlh2O8okfVr Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEEcnb6wTa5IGnmYevHs2OJc3ycR40FAl2m4loACgkQs2OJc3yc R41XqRAAksuctYdUleJ+shcofoBFkWZ/m4qjkas4H7En1m335TPg9vb/si5fUdB6 Cm/faPrpukHDxuq46v7mXBIGll5RSTyQKTtG/z0vI0tv1f2mOq53A0icWDCVNFa0 Yp+qFVBmmG5REc/iskDDg+lZRoXETPaZUpT2oVd6mt242nmyKkPLtTyLZgms0vON xAQKwyP3Km2E4eywz+4E77+eHbD19po0PCvL0JGVEWzzJh0It/rFUIzlxhu0SrK8 pgO7AcoJnW7XBOjzrifxymcem/37soJ7Z/Mc57kcyBd20Uy9NHgQDq5OehiW0+CD XFEqceM/ScM3u5RJtufxObCKXiKEqrY7Nx/kD4HOO+gKZGLKjAcDsEafDw7q4K6r JCvL6C4XPJCKQI87WZPcvn014H46YJIe3EKnYSpVvCfyaHUFj4uebeatDOU9QD7V 3XGAAVVCM4TgyOmPaNKlb5p+zFl9op0V6d3/XBMmrX6BnnX8vQzoza5QBW1QTYHY FsMA2xPC07MySoJx/F0LYzunfPJ8oYu2Qnwosk41s6oWrjOIc1WI8ZVDP28sPXF+ safnp94bvkY2VtnWhssr772OynVO0S70QBMNDwlRV36gfsGE2anmUxNaFqHmGvit 127uUbXoXxWjrriDjN+wF4nBDxeHwg58EbCVsq9P2nrYlTUV0iA= =6CAY -----END PGP SIGNATURE----- --K8CQZCbAvYz1T88CoclTj5Hlh2O8okfVr-- From owner-freebsd-xen@freebsd.org Wed Oct 16 09:28:32 2019 Return-Path: Delivered-To: freebsd-xen@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id DAE871605CA for ; Wed, 16 Oct 2019 09:28:32 +0000 (UTC) (envelope-from roger.pau@citrix.com) Received: from esa2.hc3370-68.iphmx.com (esa2.hc3370-68.iphmx.com [216.71.145.153]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "esa2.hc3370-68.iphmx.com", Issuer "HydrantID SSL ICA G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 46tRmv63dBz4Vjy for ; Wed, 16 Oct 2019 09:28:31 +0000 (UTC) (envelope-from roger.pau@citrix.com) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=citrix.com; s=securemail; t=1571218112; h=date:from:to:cc:subject:message-id:references: mime-version:in-reply-to; bh=GXb2D6hYUeH2d3aO3NqIxOGK94q8mTgO+UPIlvCLXmo=; b=WxcG4zzewsmY1flZWpe4M31fWZ8Oy/m+3eUM0LrSzTsMJwoKa6Mg6j8p dbhBzChEKvbi90n+u6r5ekhIqVZjsMGrSdMzdMQuKJOuwSoUHUyHLv6AH dhPeAaXg0BFSUPflGyQKiR6v0j5IfMxlaYuU1nOKmJE8Mdjo9JR3OsVp8 E=; Received-SPF: None (esa2.hc3370-68.iphmx.com: no sender authenticity information available from domain of roger.pau@citrix.com) identity=pra; client-ip=162.221.158.21; receiver=esa2.hc3370-68.iphmx.com; envelope-from="roger.pau@citrix.com"; x-sender="roger.pau@citrix.com"; x-conformance=sidf_compatible Received-SPF: Pass (esa2.hc3370-68.iphmx.com: domain of roger.pau@citrix.com designates 162.221.158.21 as permitted sender) identity=mailfrom; client-ip=162.221.158.21; receiver=esa2.hc3370-68.iphmx.com; envelope-from="roger.pau@citrix.com"; x-sender="roger.pau@citrix.com"; x-conformance=sidf_compatible; x-record-type="v=spf1"; x-record-text="v=spf1 ip4:209.167.231.154 ip4:178.63.86.133 ip4:195.66.111.40/30 ip4:85.115.9.32/28 ip4:199.102.83.4 ip4:192.28.146.160 ip4:192.28.146.107 ip4:216.52.6.88 ip4:216.52.6.188 ip4:162.221.158.21 ip4:162.221.156.83 ip4:168.245.78.127 ~all" Received-SPF: None (esa2.hc3370-68.iphmx.com: no sender authenticity information available from domain of postmaster@mail.citrix.com) identity=helo; client-ip=162.221.158.21; receiver=esa2.hc3370-68.iphmx.com; envelope-from="roger.pau@citrix.com"; x-sender="postmaster@mail.citrix.com"; x-conformance=sidf_compatible IronPort-SDR: iC6kVZzeM/5VQ4yDk9UXDTIa8yoL1J9v6Ft/Vdw9rr4gw2Rf7B46mb4rYPfzCt/Z6K0OjGiUP8 c7VKMMqYuBUDCr69r3m7yv2wDM9qpChxEMtDqkLF+Qbw4QkcwUIt8YxIRXQDHs9vG9e6qzymHH lH8WWwqmB3ucl2tqIMWfWoAIahL4e4csurRXqrN7Z013z/saH4CBFEvtnDjdIcLsToB1itIUs3 oG51rMaxNODuLSxnXuJZD0AO69xDm9FaU9Yqsbb4NO6m35LW7PfSi4TnjIWoypRGeTxPT/vyie B4E= X-SBRS: 2.7 X-MesageID: 6946034 X-Ironport-Server: esa2.hc3370-68.iphmx.com X-Remote-IP: 162.221.158.21 X-Policy: $RELAYED X-IronPort-AV: E=Sophos;i="5.67,303,1566878400"; d="scan'208";a="6946034" Date: Wed, 16 Oct 2019 11:28:23 +0200 From: Roger Pau =?iso-8859-1?Q?Monn=E9?= To: Stefan Parvu CC: Subject: Re: cannot install FreeBSD 12.0 Xen 4.12.1 on Intel Core i7 CPU 930 Message-ID: <20191016092823.GG14005@Air-de-Roger> References: <20191016084050.GD14005@Air-de-Roger> <4D6CBDA5-711B-4501-AFC1-A41D1134EF73@kronometrix.org> <20191016090022.GE14005@Air-de-Roger> <9D9848D6-2634-4777-9EE0-8DECAD2FE5CD@kronometrix.org> <20191016091230.GF14005@Air-de-Roger> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.12.2 (2019-09-21) X-ClientProxiedBy: AMSPEX02CAS01.citrite.net (10.69.22.112) To AMSPEX02CL02.citrite.net (10.69.22.126) X-Rspamd-Queue-Id: 46tRmv63dBz4Vjy X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=citrix.com header.s=securemail header.b=WxcG4zze; dmarc=pass (policy=none) header.from=citrix.com; spf=pass (mx1.freebsd.org: domain of roger.pau@citrix.com designates 216.71.145.153 as permitted sender) smtp.mailfrom=roger.pau@citrix.com X-Spamd-Result: default: False [-5.75 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[citrix.com:s=securemail]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; RCVD_DKIM_ARC_DNSWL_MED(-0.50)[]; DWL_DNSWL_LOW(-1.00)[citrix.com.dwl.dnswl.org : 127.0.9.1]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[citrix.com:+]; RCVD_IN_DNSWL_MED(-0.20)[153.145.71.216.list.dnswl.org : 127.0.3.2]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[citrix.com,none]; RCVD_COUNT_ZERO(0.00)[0]; FROM_EQ_ENVFROM(0.00)[]; MID_RHS_NOT_FQDN(0.50)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:16417, ipnet:216.71.145.0/24, country:US]; IP_SCORE(-1.55)[ip: (-4.92), ipnet: 216.71.145.0/24(-1.43), asn: 16417(-1.34), country: US(-0.05)] X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Oct 2019 09:28:32 -0000 On Wed, Oct 16, 2019 at 12:17:20PM +0300, Stefan Parvu wrote: > > > > Your box doesn't seem to have an iommu (aka vt-d for Intel). > > In BIOS I do have VT-D Enabled option. Would that be broken or not working ? Are you sure it's VT-d and not VT-x what you have enabled in the BIOS? Looking at the details of your CPU: https://ark.intel.com/content/www/us/en/ark/products/41447/intel-core-i7-930-processor-8m-cache-2-80-ghz-4-80-gt-s-intel-qpi.html VT-d is not listed in 'Advanced Technologies'. For example looking at a newer model: https://ark.intel.com/content/www/us/en/ark/products/149091/intel-core-i7-8565u-processor-8m-cache-up-to-4-60-ghz.html You can see VT-d listed in 'Advanced Technologies'. > I think I have used Xen a bit older version on Debian some time back if Im not wrong, on the same hdw. See below. > >> But you need all boot log. I will try your option tonight. I cant access the hardware now. > > > > If you can that would be helpful, but AFAIK this box is simply not > > capable of running a Xen PVH dom0 (which is the only mode FreeBSD > > supports in order to work as dom0). Either it has a broken iommu or no > > iommu at all. > > Hmmm. Thats strange since I do recall I had previously used here Xen but on Linux. But older > version. Could it be something changed regarding Xen and iommu or ? Linux dom0 would likely be in PV mode (note the missing H), which doesn't require an iommu. OTOH FreeBSD only supports PVH dom0, which does require an iommu. Roger. From owner-freebsd-xen@freebsd.org Wed Oct 16 10:09:54 2019 Return-Path: Delivered-To: freebsd-xen@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id B0A92161476 for ; Wed, 16 Oct 2019 10:09:54 +0000 (UTC) (envelope-from sparvu@kronometrix.org) Received: from mail.kronometrix.org (mail.kronometrix.org [95.85.46.90]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mail.kronometrix.org", Issuer "mail.kronometrix.org" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 46tShd5tdzz4XpB for ; Wed, 16 Oct 2019 10:09:53 +0000 (UTC) (envelope-from sparvu@kronometrix.org) Received: from [192.168.1.191] (82-203-142-243.bb.dnainternet.fi [82.203.142.243]) (authenticated bits=0) by mail.kronometrix.org (8.15.2/8.15.2) with ESMTPSA id x9GA9G8j087013 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Wed, 16 Oct 2019 10:09:47 GMT (envelope-from sparvu@kronometrix.org) X-Authentication-Warning: mail.kronometrix.org: Host 82-203-142-243.bb.dnainternet.fi [82.203.142.243] claimed to be [192.168.1.191] Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 12.4 \(3445.104.11\)) Subject: Re: cannot install FreeBSD 12.0 Xen 4.12.1 on Intel Core i7 CPU 930 From: Stefan Parvu In-Reply-To: <20191016092823.GG14005@Air-de-Roger> Date: Wed, 16 Oct 2019 13:09:11 +0300 Cc: freebsd-xen@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: References: <20191016084050.GD14005@Air-de-Roger> <4D6CBDA5-711B-4501-AFC1-A41D1134EF73@kronometrix.org> <20191016090022.GE14005@Air-de-Roger> <9D9848D6-2634-4777-9EE0-8DECAD2FE5CD@kronometrix.org> <20191016091230.GF14005@Air-de-Roger> <20191016092823.GG14005@Air-de-Roger> To: =?utf-8?Q?Roger_Pau_Monn=C3=A9?= X-Mailer: Apple Mail (2.3445.104.11) X-Rspamd-Queue-Id: 46tShd5tdzz4XpB X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of sparvu@kronometrix.org designates 95.85.46.90 as permitted sender) smtp.mailfrom=sparvu@kronometrix.org X-Spamd-Result: default: False [-0.08 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; MV_CASE(0.50)[]; MIME_GOOD(-0.10)[text/plain]; HAS_XAW(0.00)[]; DMARC_NA(0.00)[kronometrix.org]; NEURAL_SPAM_MEDIUM(0.05)[0.050,0]; NEURAL_HAM_LONG(-0.95)[-0.948,0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; IP_SCORE(0.62)[ip: (0.44), ipnet: 95.85.0.0/18(1.01), asn: 14061(1.72), country: US(-0.05)]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:14061, ipnet:95.85.0.0/18, country:US]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Oct 2019 10:09:54 -0000 thank you guys for tips. > Are you sure it's VT-d and not VT-x what you have enabled in the BIOS? Yes, I think the ASUS BIOS had listed VT-d. But will double check = tonight. But it might be=20 that the CPU does not support VT-d. Thats very true. Hmmm. Is there any = point even to update the CPU on this system, would it even support some new CPU models = ?=20 > Linux dom0 would likely be in PV mode (note the missing H), which > doesn't require an iommu. OTOH FreeBSD only supports PVH dom0, which > does require an iommu. Right. It could be tat I was using PV mode (paravirtualisation) mode, = without HVM extensions which PVH uses. Right ? Thats I cant say. It was some time = back.=20 Stefan= From owner-freebsd-xen@freebsd.org Wed Oct 16 10:19:48 2019 Return-Path: Delivered-To: freebsd-xen@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id AAACE161623 for ; Wed, 16 Oct 2019 10:19:48 +0000 (UTC) (envelope-from roger.pau@citrix.com) Received: from esa5.hc3370-68.iphmx.com (esa5.hc3370-68.iphmx.com [216.71.155.168]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "esa5.hc3370-68.iphmx.com", Issuer "HydrantID SSL ICA G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 46tSw419Jbz4Y7g for ; Wed, 16 Oct 2019 10:19:47 +0000 (UTC) (envelope-from roger.pau@citrix.com) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=citrix.com; s=securemail; t=1571221188; h=date:from:to:cc:subject:message-id:references: mime-version:in-reply-to; bh=WR7hbfVoarn2QUEEYmHYIXcCyRpUeZwb6aLYJPVfaBY=; b=fs+CeYWD2wJgpnnoqR/LjpNWUhXVRh4zkabkZInNYcUB9VfgzHzWEO+/ rEO9jym3UMmg0xtigR2UufQd88ps8bbvhtwPOntqpZoejZD0No6lHV9F0 KbeVUSBDFP6FjSvZ2F1NLNCVChGtfvAS2mND3h85mvjquoBad6++mj9Zj 4=; Received-SPF: None (esa5.hc3370-68.iphmx.com: no sender authenticity information available from domain of roger.pau@citrix.com) identity=pra; client-ip=162.221.158.21; receiver=esa5.hc3370-68.iphmx.com; envelope-from="roger.pau@citrix.com"; x-sender="roger.pau@citrix.com"; x-conformance=sidf_compatible Received-SPF: Pass (esa5.hc3370-68.iphmx.com: domain of roger.pau@citrix.com designates 162.221.158.21 as permitted sender) identity=mailfrom; client-ip=162.221.158.21; receiver=esa5.hc3370-68.iphmx.com; envelope-from="roger.pau@citrix.com"; x-sender="roger.pau@citrix.com"; x-conformance=sidf_compatible; x-record-type="v=spf1"; x-record-text="v=spf1 ip4:209.167.231.154 ip4:178.63.86.133 ip4:195.66.111.40/30 ip4:85.115.9.32/28 ip4:199.102.83.4 ip4:192.28.146.160 ip4:192.28.146.107 ip4:216.52.6.88 ip4:216.52.6.188 ip4:162.221.158.21 ip4:162.221.156.83 ip4:168.245.78.127 ~all" Received-SPF: None (esa5.hc3370-68.iphmx.com: no sender authenticity information available from domain of postmaster@mail.citrix.com) identity=helo; client-ip=162.221.158.21; receiver=esa5.hc3370-68.iphmx.com; envelope-from="roger.pau@citrix.com"; x-sender="postmaster@mail.citrix.com"; x-conformance=sidf_compatible IronPort-SDR: gIgEoiMPfhgMfJUlB3PM9XDMyOHsiyVhkmc4HZ8JXUkAoYjwNcQZdWSIAWwAMo0Ug5cPTTAlCe C0KgcqMdn8bPE1qCQos+oN1dAA8g8IgBAmZSw5NGhOSK2JNnR4DrhSYrABpHtyvpObz8au/d6m xGnqu8crWW5VVmNBoQtKyG9CXnYiL1BWAEJdKeznjrBpQMSJI9NXgwcmcviGd5IwPeJOl7/4aT +U++azudQJje7CjdsTWCNM/rHhNXfc6WalbQK5nL+7ObvDS9smerdIuDBzwegBKR1nzD+wv83O vgY= X-SBRS: 2.7 X-MesageID: 7233903 X-Ironport-Server: esa5.hc3370-68.iphmx.com X-Remote-IP: 162.221.158.21 X-Policy: $RELAYED X-IronPort-AV: E=Sophos;i="5.67,303,1566878400"; d="scan'208";a="7233903" Date: Wed, 16 Oct 2019 12:19:39 +0200 From: Roger Pau =?iso-8859-1?Q?Monn=E9?= To: Stefan Parvu CC: Subject: Re: cannot install FreeBSD 12.0 Xen 4.12.1 on Intel Core i7 CPU 930 Message-ID: <20191016101939.GH14005@Air-de-Roger> References: <20191016084050.GD14005@Air-de-Roger> <4D6CBDA5-711B-4501-AFC1-A41D1134EF73@kronometrix.org> <20191016090022.GE14005@Air-de-Roger> <9D9848D6-2634-4777-9EE0-8DECAD2FE5CD@kronometrix.org> <20191016091230.GF14005@Air-de-Roger> <20191016092823.GG14005@Air-de-Roger> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.12.2 (2019-09-21) X-ClientProxiedBy: AMSPEX02CAS01.citrite.net (10.69.22.112) To AMSPEX02CL02.citrite.net (10.69.22.126) X-Rspamd-Queue-Id: 46tSw419Jbz4Y7g X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=citrix.com header.s=securemail header.b=fs+CeYWD; dmarc=pass (policy=none) header.from=citrix.com; spf=pass (mx1.freebsd.org: domain of roger.pau@citrix.com designates 216.71.155.168 as permitted sender) smtp.mailfrom=roger.pau@citrix.com X-Spamd-Result: default: False [-6.35 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[citrix.com:s=securemail]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; RCVD_DKIM_ARC_DNSWL_MED(-0.50)[]; DWL_DNSWL_LOW(-1.00)[citrix.com.dwl.dnswl.org : 127.0.9.1]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_MED(-0.20)[168.155.71.216.list.dnswl.org : 127.0.3.2]; DKIM_TRACE(0.00)[citrix.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[citrix.com,none]; RCVD_COUNT_ZERO(0.00)[0]; FROM_EQ_ENVFROM(0.00)[]; MID_RHS_NOT_FQDN(0.50)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:16417, ipnet:216.71.154.0/23, country:US]; IP_SCORE(-2.15)[ip: (-6.63), ipnet: 216.71.154.0/23(-2.75), asn: 16417(-1.34), country: US(-0.05)] X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Oct 2019 10:19:48 -0000 On Wed, Oct 16, 2019 at 01:09:11PM +0300, Stefan Parvu wrote: > thank you guys for tips. > > > Are you sure it's VT-d and not VT-x what you have enabled in the BIOS? > > Yes, I think the ASUS BIOS had listed VT-d. But will double check tonight. But it might be > that the CPU does not support VT-d. Thats very true. Hmmm. Is there any point even to > update the CPU on this system, would it even support some new CPU models ? I'm afraid I have no idea. I don't deal with hardware setup myself. > > Linux dom0 would likely be in PV mode (note the missing H), which > > doesn't require an iommu. OTOH FreeBSD only supports PVH dom0, which > > does require an iommu. > > Right. It could be tat I was using PV mode (paravirtualisation) mode, without HVM > extensions which PVH uses. Right ? Thats I cant say. It was some time back. So in order to provide an overview: - PV doesn't require VT-x nor VT-d. - PV guests with pci-passthrough devices require VT-d for safety reasons. - PVH/HVM require VT-x. - PVH dom0 or HVM/PVH guests with pci-passthrough devices require both VT-d and VT-x. Roger. From owner-freebsd-xen@freebsd.org Wed Oct 16 11:08:13 2019 Return-Path: Delivered-To: freebsd-xen@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 57C571620CA for ; Wed, 16 Oct 2019 11:08:13 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from kib.kiev.ua (kib.kiev.ua [IPv6:2001:470:d5e7:1::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 46tTzw1T9vz4b2D for ; Wed, 16 Oct 2019 11:08:11 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from tom.home (kib@localhost [127.0.0.1]) by kib.kiev.ua (8.15.2/8.15.2) with ESMTPS id x9GB7t6K076984 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Wed, 16 Oct 2019 14:07:58 +0300 (EEST) (envelope-from kostikbel@gmail.com) DKIM-Filter: OpenDKIM Filter v2.10.3 kib.kiev.ua x9GB7t6K076984 Received: (from kostik@localhost) by tom.home (8.15.2/8.15.2/Submit) id x9GB7tLl076983; Wed, 16 Oct 2019 14:07:55 +0300 (EEST) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: tom.home: kostik set sender to kostikbel@gmail.com using -f Date: Wed, 16 Oct 2019 14:07:55 +0300 From: Konstantin Belousov To: Roger Pau =?utf-8?B?TW9ubsOp?= Cc: Stefan Parvu , freebsd-xen@freebsd.org Subject: Re: cannot install FreeBSD 12.0 Xen 4.12.1 on Intel Core i7 CPU 930 Message-ID: <20191016110755.GF73312@kib.kiev.ua> References: <20191016084050.GD14005@Air-de-Roger> <4D6CBDA5-711B-4501-AFC1-A41D1134EF73@kronometrix.org> <20191016090022.GE14005@Air-de-Roger> <9D9848D6-2634-4777-9EE0-8DECAD2FE5CD@kronometrix.org> <20191016091230.GF14005@Air-de-Roger> <20191016092823.GG14005@Air-de-Roger> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <20191016092823.GG14005@Air-de-Roger> User-Agent: Mutt/1.12.2 (2019-09-21) X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED,BAYES_00, DKIM_ADSP_CUSTOM_MED,FORGED_GMAIL_RCVD,FREEMAIL_FROM, NML_ADSP_CUSTOM_MED autolearn=no autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on tom.home X-Rspamd-Queue-Id: 46tTzw1T9vz4b2D X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=fail reason="No valid SPF, No valid DKIM" header.from=gmail.com (policy=none); spf=softfail (mx1.freebsd.org: 2001:470:d5e7:1::1 is neither permitted nor denied by domain of kostikbel@gmail.com) smtp.mailfrom=kostikbel@gmail.com X-Spamd-Result: default: False [-2.00 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; DMARC_POLICY_SOFTFAIL(0.10)[gmail.com : No valid SPF, No valid DKIM,none]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; FREEMAIL_FROM(0.00)[gmail.com]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; HAS_XAW(0.00)[]; R_SPF_SOFTFAIL(0.00)[~all]; IP_SCORE_FREEMAIL(0.00)[]; TO_DN_SOME(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; IP_SCORE(0.00)[ip: (-2.74), ipnet: 2001:470::/32(-4.58), asn: 6939(-3.41), country: US(-0.05)]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:6939, ipnet:2001:470::/32, country:US]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Oct 2019 11:08:13 -0000 On Wed, Oct 16, 2019 at 11:28:23AM +0200, Roger Pau Monné wrote: > On Wed, Oct 16, 2019 at 12:17:20PM +0300, Stefan Parvu wrote: > > > > > > Your box doesn't seem to have an iommu (aka vt-d for Intel). > > > > In BIOS I do have VT-D Enabled option. Would that be broken or not working ? > > Are you sure it's VT-d and not VT-x what you have enabled in the BIOS? > > Looking at the details of your CPU: > > https://ark.intel.com/content/www/us/en/ark/products/41447/intel-core-i7-930-processor-8m-cache-2-80-ghz-4-80-gt-s-intel-qpi.html > > VT-d is not listed in 'Advanced Technologies'. For example looking at > a newer model: > > https://ark.intel.com/content/www/us/en/ark/products/149091/intel-core-i7-8565u-processor-8m-cache-up-to-4-60-ghz.html > > You can see VT-d listed in 'Advanced Technologies'. Nehalems do have VT-d, but they have dedicated chip with north bridge still, CPU only provided memory controller. So VT-d is the feature of the chipset, e.g. X58, not mentioning Xeon chipsets. On the other hand, VT-d support was relatively buggy, could it be that Xen kernel refuses to use it due to the problems ? > > > I think I have used Xen a bit older version on Debian some time back if Im not wrong, on the same hdw. > > See below. > > > >> But you need all boot log. I will try your option tonight. I cant access the hardware now. > > > > > > If you can that would be helpful, but AFAIK this box is simply not > > > capable of running a Xen PVH dom0 (which is the only mode FreeBSD > > > supports in order to work as dom0). Either it has a broken iommu or no > > > iommu at all. > > > > Hmmm. Thats strange since I do recall I had previously used here Xen but on Linux. But older > > version. Could it be something changed regarding Xen and iommu or ? > > Linux dom0 would likely be in PV mode (note the missing H), which > doesn't require an iommu. OTOH FreeBSD only supports PVH dom0, which > does require an iommu. > > Roger. > _______________________________________________ > freebsd-xen@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-xen > To unsubscribe, send any mail to "freebsd-xen-unsubscribe@freebsd.org" From owner-freebsd-xen@freebsd.org Wed Oct 16 11:30:59 2019 Return-Path: Delivered-To: freebsd-xen@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 1403C1625B2 for ; Wed, 16 Oct 2019 11:30:59 +0000 (UTC) (envelope-from roger.pau@citrix.com) Received: from esa6.hc3370-68.iphmx.com (esa6.hc3370-68.iphmx.com [216.71.155.175]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "esa6.hc3370-68.iphmx.com", Issuer "HydrantID SSL ICA G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 46tVV93Hs9z4c4w for ; Wed, 16 Oct 2019 11:30:57 +0000 (UTC) (envelope-from roger.pau@citrix.com) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=citrix.com; s=securemail; t=1571225457; h=date:from:to:cc:subject:message-id:references: mime-version:content-transfer-encoding:in-reply-to; bh=coP18kd//r1H8WD1Y3zZIbzx+bnvhzrv3K1LfpEPet0=; b=K65xKG0nUbLqF0pthiFxoD9fkUAOiren+q/nZlRy+K15yC++n8j1l3Sc Ph7DaV6M0DAr1s+ie1kCkRHZJXtsa++3fR3QsGtep7szCZIL6GPbHUA/k oQ1y09A+KnpaevxFpwVgehbV9icSGoc7ITNsrcCr6otCGK1cliGTuJNUA s=; Received-SPF: None (esa6.hc3370-68.iphmx.com: no sender authenticity information available from domain of roger.pau@citrix.com) identity=pra; client-ip=162.221.158.21; receiver=esa6.hc3370-68.iphmx.com; envelope-from="roger.pau@citrix.com"; x-sender="roger.pau@citrix.com"; x-conformance=sidf_compatible Received-SPF: Pass (esa6.hc3370-68.iphmx.com: domain of roger.pau@citrix.com designates 162.221.158.21 as permitted sender) identity=mailfrom; client-ip=162.221.158.21; receiver=esa6.hc3370-68.iphmx.com; envelope-from="roger.pau@citrix.com"; x-sender="roger.pau@citrix.com"; x-conformance=sidf_compatible; x-record-type="v=spf1"; x-record-text="v=spf1 ip4:209.167.231.154 ip4:178.63.86.133 ip4:195.66.111.40/30 ip4:85.115.9.32/28 ip4:199.102.83.4 ip4:192.28.146.160 ip4:192.28.146.107 ip4:216.52.6.88 ip4:216.52.6.188 ip4:162.221.158.21 ip4:162.221.156.83 ip4:168.245.78.127 ~all" Received-SPF: None (esa6.hc3370-68.iphmx.com: no sender authenticity information available from domain of postmaster@mail.citrix.com) identity=helo; client-ip=162.221.158.21; receiver=esa6.hc3370-68.iphmx.com; envelope-from="roger.pau@citrix.com"; x-sender="postmaster@mail.citrix.com"; x-conformance=sidf_compatible IronPort-SDR: 5f/0WiGADQVFG2dXUIhldiUYUBsFmuaNxcs4PKPVYmU7dolHk9HRUVVws/gyymFAgX4qL0jLBG Rug1Wks2KcV7U5pxTpewCoDAojsPukN9oSx/c6A9tXPCfADucsZX86SrCH0hbKFc4835vbKz5e yjj7n7z0PrMobDV8Q293lL09MSWESlkey3PQYMElvDAJNP/BxFfeD0Q1t5HAax9v6bK1bcZl7b cK/2cj5YNaRYxJZWus8OcLNMIbd4huy5sIGN/WgKCpnXd4f/wE2BWeUqbEczrYA0zEvGNI/Aqy 6KY= X-SBRS: 2.7 X-MesageID: 7275515 X-Ironport-Server: esa6.hc3370-68.iphmx.com X-Remote-IP: 162.221.158.21 X-Policy: $RELAYED X-IronPort-AV: E=Sophos;i="5.67,303,1566878400"; d="scan'208";a="7275515" Date: Wed, 16 Oct 2019 13:30:47 +0200 From: Roger Pau =?iso-8859-1?Q?Monn=E9?= To: Konstantin Belousov CC: Stefan Parvu , Subject: Re: cannot install FreeBSD 12.0 Xen 4.12.1 on Intel Core i7 CPU 930 Message-ID: <20191016113047.GI14005@Air-de-Roger> References: <20191016084050.GD14005@Air-de-Roger> <4D6CBDA5-711B-4501-AFC1-A41D1134EF73@kronometrix.org> <20191016090022.GE14005@Air-de-Roger> <9D9848D6-2634-4777-9EE0-8DECAD2FE5CD@kronometrix.org> <20191016091230.GF14005@Air-de-Roger> <20191016092823.GG14005@Air-de-Roger> <20191016110755.GF73312@kib.kiev.ua> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <20191016110755.GF73312@kib.kiev.ua> User-Agent: Mutt/1.12.2 (2019-09-21) X-ClientProxiedBy: AMSPEX02CAS01.citrite.net (10.69.22.112) To AMSPEX02CL02.citrite.net (10.69.22.126) X-Rspamd-Queue-Id: 46tVV93Hs9z4c4w X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=citrix.com header.s=securemail header.b=K65xKG0n; dmarc=pass (policy=none) header.from=citrix.com; spf=pass (mx1.freebsd.org: domain of roger.pau@citrix.com designates 216.71.155.175 as permitted sender) smtp.mailfrom=roger.pau@citrix.com X-Spamd-Result: default: False [-5.90 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[citrix.com:s=securemail]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+mx]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; RCVD_DKIM_ARC_DNSWL_MED(-0.50)[]; TO_DN_SOME(0.00)[]; DWL_DNSWL_LOW(-1.00)[citrix.com.dwl.dnswl.org : 127.0.9.1]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_MED(-0.20)[175.155.71.216.list.dnswl.org : 127.0.3.2]; DKIM_TRACE(0.00)[citrix.com:+]; DMARC_POLICY_ALLOW(-0.50)[citrix.com,none]; FREEMAIL_TO(0.00)[gmail.com]; RCVD_COUNT_ZERO(0.00)[0]; FROM_EQ_ENVFROM(0.00)[]; MID_RHS_NOT_FQDN(0.50)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:16417, ipnet:216.71.154.0/23, country:US]; IP_SCORE(-1.70)[ip: (-4.32), ipnet: 216.71.154.0/23(-2.79), asn: 16417(-1.35), country: US(-0.05)] X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Oct 2019 11:30:59 -0000 On Wed, Oct 16, 2019 at 02:07:55PM +0300, Konstantin Belousov wrote: > On Wed, Oct 16, 2019 at 11:28:23AM +0200, Roger Pau Monn wrote: > > On Wed, Oct 16, 2019 at 12:17:20PM +0300, Stefan Parvu wrote: > > > > > > > > Your box doesn't seem to have an iommu (aka vt-d for Intel). > > > > > > In BIOS I do have VT-D Enabled option. Would that be broken or not working ? > > > > Are you sure it's VT-d and not VT-x what you have enabled in the BIOS? > > > > Looking at the details of your CPU: > > > > https://ark.intel.com/content/www/us/en/ark/products/41447/intel-core-i7-930-processor-8m-cache-2-80-ghz-4-80-gt-s-intel-qpi.html > > > > VT-d is not listed in 'Advanced Technologies'. For example looking at > > a newer model: > > > > https://ark.intel.com/content/www/us/en/ark/products/149091/intel-core-i7-8565u-processor-8m-cache-up-to-4-60-ghz.html > > > > You can see VT-d listed in 'Advanced Technologies'. > Nehalems do have VT-d, but they have dedicated chip with north bridge > still, CPU only provided memory controller. So VT-d is the feature of > the chipset, e.g. X58, not mentioning Xeon chipsets. On the other hand, > VT-d support was relatively buggy, could it be that Xen kernel refuses > to use it due to the problems ? It's possible that Xen refuses to enable the iommu due to erratas, I'm however unable to find the specification document of the X58 chipset with the erratas, seems to be gone from the Intel site. Stefan: When booting plain FreeBSD, can you try the following? # acpidump -t|grep DMAR DMAR: Length=180, Revision=1, Checksum=195, OEMID=A M I, OEM Table ID=OEMDMAR, OEM Revision=0x1, If you don't get output it means there's no DMAR ACPI table, and thus no VT-d support (at least from the OS point of view). Roger. From owner-freebsd-xen@freebsd.org Wed Oct 16 11:36:28 2019 Return-Path: Delivered-To: freebsd-xen@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 2A26B162736 for ; Wed, 16 Oct 2019 11:36:28 +0000 (UTC) (envelope-from sparvu@kronometrix.org) Received: from mail.kronometrix.org (mail.kronometrix.org [95.85.46.90]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mail.kronometrix.org", Issuer "mail.kronometrix.org" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 46tVcV6G53z4cFb for ; Wed, 16 Oct 2019 11:36:26 +0000 (UTC) (envelope-from sparvu@kronometrix.org) Received: from [192.168.1.191] (82-203-142-243.bb.dnainternet.fi [82.203.142.243]) (authenticated bits=0) by mail.kronometrix.org (8.15.2/8.15.2) with ESMTPSA id x9GBZoJD087701 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Wed, 16 Oct 2019 11:36:21 GMT (envelope-from sparvu@kronometrix.org) X-Authentication-Warning: mail.kronometrix.org: Host 82-203-142-243.bb.dnainternet.fi [82.203.142.243] claimed to be [192.168.1.191] From: Stefan Parvu Message-Id: Mime-Version: 1.0 (Mac OS X Mail 12.4 \(3445.104.11\)) Subject: Re: cannot install FreeBSD 12.0 Xen 4.12.1 on Intel Core i7 CPU 930 Date: Wed, 16 Oct 2019 14:35:44 +0300 In-Reply-To: <20191016113047.GI14005@Air-de-Roger> Cc: Konstantin Belousov , freebsd-xen@freebsd.org To: =?utf-8?Q?Roger_Pau_Monn=C3=A9?= References: <20191016084050.GD14005@Air-de-Roger> <4D6CBDA5-711B-4501-AFC1-A41D1134EF73@kronometrix.org> <20191016090022.GE14005@Air-de-Roger> <9D9848D6-2634-4777-9EE0-8DECAD2FE5CD@kronometrix.org> <20191016091230.GF14005@Air-de-Roger> <20191016092823.GG14005@Air-de-Roger> <20191016110755.GF73312@kib.kiev.ua> <20191016113047.GI14005@Air-de-Roger> X-Mailer: Apple Mail (2.3445.104.11) X-Rspamd-Queue-Id: 46tVcV6G53z4cFb X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of sparvu@kronometrix.org designates 95.85.46.90 as permitted sender) smtp.mailfrom=sparvu@kronometrix.org X-Spamd-Result: default: False [-0.10 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_TLS_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+mx]; MV_CASE(0.50)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; HAS_XAW(0.00)[]; DMARC_NA(0.00)[kronometrix.org]; TO_DN_SOME(0.00)[]; NEURAL_SPAM_MEDIUM(0.04)[0.042,0]; NEURAL_HAM_LONG(-0.96)[-0.958,0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; IP_SCORE(0.62)[ip: (0.43), ipnet: 95.85.0.0/18(1.00), asn: 14061(1.72), country: US(-0.05)]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:14061, ipnet:95.85.0.0/18, country:US]; FREEMAIL_CC(0.00)[gmail.com]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_COUNT_TWO(0.00)[2] Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Oct 2019 11:36:28 -0000 > When booting plain FreeBSD, can you try the following? > > # acpidump -t|grep DMAR > DMAR: Length=180, Revision=1, Checksum=195, > OEMID=A M I, OEM Table ID=OEMDMAR, OEM Revision=0x1, > > If you don't get output it means there's no DMAR ACPI table, and thus > no VT-d support (at least from the OS point of view). sure. Will try this and report back in couple of hours. From owner-freebsd-xen@freebsd.org Wed Oct 16 15:16:15 2019 Return-Path: Delivered-To: freebsd-xen@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id AB2B716775B for ; Wed, 16 Oct 2019 15:16:15 +0000 (UTC) (envelope-from sparvu@kronometrix.org) Received: from mail.kronometrix.org (mail.kronometrix.org [95.85.46.90]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mail.kronometrix.org", Issuer "mail.kronometrix.org" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 46tbV65jfnz3NrD for ; Wed, 16 Oct 2019 15:16:14 +0000 (UTC) (envelope-from sparvu@kronometrix.org) Received: from [192.168.1.4] (mail.kronometrix.com [79.134.105.181]) (authenticated bits=0) by mail.kronometrix.org (8.15.2/8.15.2) with ESMTPSA id x9GFFdQP089279 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Wed, 16 Oct 2019 15:16:09 GMT (envelope-from sparvu@kronometrix.org) X-Authentication-Warning: mail.kronometrix.org: Host mail.kronometrix.com [79.134.105.181] claimed to be [192.168.1.4] From: Stefan Parvu Message-Id: Mime-Version: 1.0 (Mac OS X Mail 12.4 \(3445.104.11\)) Subject: Re: cannot install FreeBSD 12.0 Xen 4.12.1 on Intel Core i7 CPU 930 Date: Wed, 16 Oct 2019 18:15:33 +0300 In-Reply-To: <20191016113047.GI14005@Air-de-Roger> Cc: Konstantin Belousov , freebsd-xen@freebsd.org To: =?utf-8?Q?Roger_Pau_Monn=C3=A9?= References: <20191016084050.GD14005@Air-de-Roger> <4D6CBDA5-711B-4501-AFC1-A41D1134EF73@kronometrix.org> <20191016090022.GE14005@Air-de-Roger> <9D9848D6-2634-4777-9EE0-8DECAD2FE5CD@kronometrix.org> <20191016091230.GF14005@Air-de-Roger> <20191016092823.GG14005@Air-de-Roger> <20191016110755.GF73312@kib.kiev.ua> <20191016113047.GI14005@Air-de-Roger> X-Mailer: Apple Mail (2.3445.104.11) X-Rspamd-Queue-Id: 46tbV65jfnz3NrD X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of sparvu@kronometrix.org designates 95.85.46.90 as permitted sender) smtp.mailfrom=sparvu@kronometrix.org X-Spamd-Result: default: False [-0.02 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_TLS_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+mx]; MV_CASE(0.50)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; HAS_XAW(0.00)[]; DMARC_NA(0.00)[kronometrix.org]; TO_DN_SOME(0.00)[]; NEURAL_SPAM_MEDIUM(0.11)[0.113,0]; NEURAL_HAM_LONG(-0.95)[-0.954,0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; IP_SCORE(0.62)[ip: (0.42), ipnet: 95.85.0.0/18(0.99), asn: 14061(1.72), country: US(-0.05)]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:14061, ipnet:95.85.0.0/18, country:US]; FREEMAIL_CC(0.00)[gmail.com]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_COUNT_TWO(0.00)[2] Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Oct 2019 15:16:15 -0000 > # acpidump -t|grep DMAR > DMAR: Length=180, Revision=1, Checksum=195, > OEMID=A M I, OEM Table ID=OEMDMAR, OEM Revision=0x1, > root@earth:~ # acpidump -t | grep DMAR DMAR: Length=288, Revision=1, Checksum=93, OEMID=AMI, OEM Table ID=OEMDMAR, OEM Revision=0x1, this is it. Stefan From owner-freebsd-xen@freebsd.org Wed Oct 16 15:27:46 2019 Return-Path: Delivered-To: freebsd-xen@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E3659167BA0 for ; Wed, 16 Oct 2019 15:27:46 +0000 (UTC) (envelope-from roger.pau@citrix.com) Received: from esa3.hc3370-68.iphmx.com (esa3.hc3370-68.iphmx.com [216.71.145.155]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "esa3.hc3370-68.iphmx.com", Issuer "HydrantID SSL ICA G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 46tblQ0kPJz3Pb5 for ; Wed, 16 Oct 2019 15:27:45 +0000 (UTC) (envelope-from roger.pau@citrix.com) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=citrix.com; s=securemail; t=1571239666; h=date:from:to:cc:subject:message-id:references: mime-version:in-reply-to; bh=E5N3yMgsWs48eGsnmA00KiMx8PWb0A37MN5EYtBO3fw=; b=G4BCILoCoL3QxkLPVY4msvWg0LWfkO58CrDQrfAGqPGNsGV66n3xKVB4 PRAs3ANUkrq7ejMAuWBsyt7a907QJtFIeZVQl0IyblIoz32soRDlCCrz9 q3J3hyR89o1QZiBEnU8t+FQRUEaiM0p8gCv+NvmZrAMFQ7obg6LU8ab/f 4=; Received-SPF: None (esa3.hc3370-68.iphmx.com: no sender authenticity information available from domain of roger.pau@citrix.com) identity=pra; client-ip=162.221.158.21; receiver=esa3.hc3370-68.iphmx.com; envelope-from="roger.pau@citrix.com"; x-sender="roger.pau@citrix.com"; x-conformance=sidf_compatible Received-SPF: Pass (esa3.hc3370-68.iphmx.com: domain of roger.pau@citrix.com designates 162.221.158.21 as permitted sender) identity=mailfrom; client-ip=162.221.158.21; receiver=esa3.hc3370-68.iphmx.com; envelope-from="roger.pau@citrix.com"; x-sender="roger.pau@citrix.com"; x-conformance=sidf_compatible; x-record-type="v=spf1"; x-record-text="v=spf1 ip4:209.167.231.154 ip4:178.63.86.133 ip4:195.66.111.40/30 ip4:85.115.9.32/28 ip4:199.102.83.4 ip4:192.28.146.160 ip4:192.28.146.107 ip4:216.52.6.88 ip4:216.52.6.188 ip4:162.221.158.21 ip4:162.221.156.83 ip4:168.245.78.127 ~all" Received-SPF: None (esa3.hc3370-68.iphmx.com: no sender authenticity information available from domain of postmaster@mail.citrix.com) identity=helo; client-ip=162.221.158.21; receiver=esa3.hc3370-68.iphmx.com; envelope-from="roger.pau@citrix.com"; x-sender="postmaster@mail.citrix.com"; x-conformance=sidf_compatible IronPort-SDR: 0gscWRf/JUELkw2QmqUrEyEdhGo7kXs16dNfLwoe3bbkz2Xc6K8bnuhCfRz965KjsH0fJF1qcV uxRMolSZv/3qPAiAOuIoAZMl2eNqFUjjfDr3M0mkm5GDB9FFr0qe7/7rS4OFYeprwGM/Zg2T/s oTCsfJc+WuuEDkCvY2VmFIPPV2LvCw1bM2ldygR4fVFOVArtRYkoZHmw6DwgVZTNeK2MsAsZ/D 0EnHtfT5AOIGDXbnJufD5hEEhG6cULUvdgWwKCFwh427veX2JUO1KaWENS6/rkulzyad9YLeUe iw0= X-SBRS: 2.7 X-MesageID: 6965774 X-Ironport-Server: esa3.hc3370-68.iphmx.com X-Remote-IP: 162.221.158.21 X-Policy: $RELAYED X-IronPort-AV: E=Sophos;i="5.67,304,1566878400"; d="scan'208";a="6965774" Date: Wed, 16 Oct 2019 17:27:36 +0200 From: Roger Pau =?iso-8859-1?Q?Monn=E9?= To: Stefan Parvu CC: Konstantin Belousov , Subject: Re: cannot install FreeBSD 12.0 Xen 4.12.1 on Intel Core i7 CPU 930 Message-ID: <20191016152736.GJ14005@Air-de-Roger> References: <20191016084050.GD14005@Air-de-Roger> <4D6CBDA5-711B-4501-AFC1-A41D1134EF73@kronometrix.org> <20191016090022.GE14005@Air-de-Roger> <9D9848D6-2634-4777-9EE0-8DECAD2FE5CD@kronometrix.org> <20191016091230.GF14005@Air-de-Roger> <20191016092823.GG14005@Air-de-Roger> <20191016110755.GF73312@kib.kiev.ua> <20191016113047.GI14005@Air-de-Roger> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.12.2 (2019-09-21) X-ClientProxiedBy: AMSPEX02CAS02.citrite.net (10.69.22.113) To AMSPEX02CL02.citrite.net (10.69.22.126) X-Rspamd-Queue-Id: 46tblQ0kPJz3Pb5 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=citrix.com header.s=securemail header.b=G4BCILoC; dmarc=pass (policy=none) header.from=citrix.com; spf=pass (mx1.freebsd.org: domain of roger.pau@citrix.com designates 216.71.145.155 as permitted sender) smtp.mailfrom=roger.pau@citrix.com X-Spamd-Result: default: False [-4.80 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[citrix.com:s=securemail]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+mx]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; IP_SCORE(-0.60)[ipnet: 216.71.145.0/24(-1.60), asn: 16417(-1.35), country: US(-0.05)]; RCVD_DKIM_ARC_DNSWL_MED(-0.50)[]; TO_DN_SOME(0.00)[]; DWL_DNSWL_LOW(-1.00)[citrix.com.dwl.dnswl.org : 127.0.9.1]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_MED(-0.20)[155.145.71.216.list.dnswl.org : 127.0.3.2]; DKIM_TRACE(0.00)[citrix.com:+]; DMARC_POLICY_ALLOW(-0.50)[citrix.com,none]; RCVD_COUNT_ZERO(0.00)[0]; FROM_EQ_ENVFROM(0.00)[]; MID_RHS_NOT_FQDN(0.50)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:16417, ipnet:216.71.145.0/24, country:US]; FREEMAIL_CC(0.00)[gmail.com] X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Oct 2019 15:27:46 -0000 On Wed, Oct 16, 2019 at 06:15:33PM +0300, Stefan Parvu wrote: > > # acpidump -t|grep DMAR > > DMAR: Length=180, Revision=1, Checksum=195, > > OEMID=A M I, OEM Table ID=OEMDMAR, OEM Revision=0x1, > > > > root@earth:~ # acpidump -t | grep DMAR > DMAR: Length=288, Revision=1, Checksum=93, > OEMID=AMI, OEM Table ID=OEMDMAR, OEM Revision=0x1, So there's an iommu, then it must be Xen refusing to use it. Is it possible for you to setup a serial console in order to get the full Xen boot log? Also, IIRC X58 had some interrupt remapping issues, can you try to boot with iommu=no-intremap? (without any other iommu options) Thanks, Roger. From owner-freebsd-xen@freebsd.org Wed Oct 16 15:59:57 2019 Return-Path: Delivered-To: freebsd-xen@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id B6018149220 for ; Wed, 16 Oct 2019 15:59:57 +0000 (UTC) (envelope-from sparvu@kronometrix.org) Received: from mail.kronometrix.org (mail.kronometrix.org [95.85.46.90]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mail.kronometrix.org", Issuer "mail.kronometrix.org" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 46tcSY093sz3xQr for ; Wed, 16 Oct 2019 15:59:56 +0000 (UTC) (envelope-from sparvu@kronometrix.org) Received: from [192.168.1.4] (mail.kronometrix.com [79.134.105.181]) (authenticated bits=0) by mail.kronometrix.org (8.15.2/8.15.2) with ESMTPSA id x9GFxqWo089609 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Wed, 16 Oct 2019 15:59:52 GMT (envelope-from sparvu@kronometrix.org) X-Authentication-Warning: mail.kronometrix.org: Host mail.kronometrix.com [79.134.105.181] claimed to be [192.168.1.4] Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 12.4 \(3445.104.11\)) Subject: Re: cannot install FreeBSD 12.0 Xen 4.12.1 on Intel Core i7 CPU 930 From: Stefan Parvu In-Reply-To: <20191016152736.GJ14005@Air-de-Roger> Date: Wed, 16 Oct 2019 18:59:46 +0300 Cc: Konstantin Belousov , freebsd-xen@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <9E59905F-984D-4F00-9B9B-ADAF48E7A565@kronometrix.org> References: <20191016084050.GD14005@Air-de-Roger> <4D6CBDA5-711B-4501-AFC1-A41D1134EF73@kronometrix.org> <20191016090022.GE14005@Air-de-Roger> <9D9848D6-2634-4777-9EE0-8DECAD2FE5CD@kronometrix.org> <20191016091230.GF14005@Air-de-Roger> <20191016092823.GG14005@Air-de-Roger> <20191016110755.GF73312@kib.kiev.ua> <20191016113047.GI14005@Air-de-Roger> <20191016152736.GJ14005@Air-de-Roger> To: =?utf-8?Q?Roger_Pau_Monn=C3=A9?= X-Mailer: Apple Mail (2.3445.104.11) X-Rspamd-Queue-Id: 46tcSY093sz3xQr X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of sparvu@kronometrix.org designates 95.85.46.90 as permitted sender) smtp.mailfrom=sparvu@kronometrix.org X-Spamd-Result: default: False [-0.36 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_TLS_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+mx]; MV_CASE(0.50)[]; MIME_GOOD(-0.10)[text/plain]; HAS_XAW(0.00)[]; DMARC_NA(0.00)[kronometrix.org]; TO_DN_SOME(0.00)[]; NEURAL_HAM_LONG(-0.98)[-0.975,0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_MEDIUM(-0.20)[-0.196,0]; IP_SCORE(0.61)[ip: (0.42), ipnet: 95.85.0.0/18(0.98), asn: 14061(1.72), country: US(-0.05)]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:14061, ipnet:95.85.0.0/18, country:US]; FREEMAIL_CC(0.00)[gmail.com]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Oct 2019 15:59:57 -0000 > Also, IIRC X58 had some interrupt remapping issues, can you try to > boot with iommu=3Dno-intremap? (without any other iommu options) Let me try quickly that. No serial it is too complicated for this = machine.=20 If we can make this running do you think FreeBSD Xen Dom0 will ever = support HVM linux guests ? stefan= From owner-freebsd-xen@freebsd.org Wed Oct 16 16:04:34 2019 Return-Path: Delivered-To: freebsd-xen@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 22164149616 for ; Wed, 16 Oct 2019 16:04:34 +0000 (UTC) (envelope-from roger.pau@citrix.com) Received: from esa1.hc3370-68.iphmx.com (esa1.hc3370-68.iphmx.com [216.71.145.142]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "esa1.hc3370-68.iphmx.com", Issuer "HydrantID SSL ICA G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 46tcYs2bL4z3xtH for ; Wed, 16 Oct 2019 16:04:33 +0000 (UTC) (envelope-from roger.pau@citrix.com) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=citrix.com; s=securemail; t=1571241874; h=date:from:to:cc:subject:message-id:references: mime-version:in-reply-to; bh=XcH1ltIp6e1wtBiE2Jd0wKQx/rGQ/yYStqtjpSufO64=; b=CQglgjUvBA46CCqKaspe0sGToWRtB7rLAoZH3EfrbfNpGr8CeR5RmeqE +5Qb0kqGmR6ijvM9XpiKfxsBuxlqkoalzhnqLGaqfwm8UI1VEXFYnh0N0 ZifyPrJgFPZwquHIk+yzu0cV+RITILNS8bgJfwVfCTsqrYBnwWkSWeIxY w=; Received-SPF: None (esa1.hc3370-68.iphmx.com: no sender authenticity information available from domain of roger.pau@citrix.com) identity=pra; client-ip=162.221.158.21; receiver=esa1.hc3370-68.iphmx.com; envelope-from="roger.pau@citrix.com"; x-sender="roger.pau@citrix.com"; x-conformance=sidf_compatible Received-SPF: Pass (esa1.hc3370-68.iphmx.com: domain of roger.pau@citrix.com designates 162.221.158.21 as permitted sender) identity=mailfrom; client-ip=162.221.158.21; receiver=esa1.hc3370-68.iphmx.com; envelope-from="roger.pau@citrix.com"; x-sender="roger.pau@citrix.com"; x-conformance=sidf_compatible; x-record-type="v=spf1"; x-record-text="v=spf1 ip4:209.167.231.154 ip4:178.63.86.133 ip4:195.66.111.40/30 ip4:85.115.9.32/28 ip4:199.102.83.4 ip4:192.28.146.160 ip4:192.28.146.107 ip4:216.52.6.88 ip4:216.52.6.188 ip4:162.221.158.21 ip4:162.221.156.83 ip4:168.245.78.127 ~all" Received-SPF: None (esa1.hc3370-68.iphmx.com: no sender authenticity information available from domain of postmaster@mail.citrix.com) identity=helo; client-ip=162.221.158.21; receiver=esa1.hc3370-68.iphmx.com; envelope-from="roger.pau@citrix.com"; x-sender="postmaster@mail.citrix.com"; x-conformance=sidf_compatible IronPort-SDR: D/1XKpxxHazMu9JJ1dNsBZKIAl/Vv4BnD7Uy8pw4l5bOe84pNXUHtFyM9n8mmbFhSdxiUec2g2 fUQpi91BFM1vJGdHexm/q49kdpWVEX7X1RGP2uPTZYDegWoSnORL4DZJ/FBxyY6KPgk6X7nqFN dEgdJAi4C/ttCBTJAerc0ags0OwIpqg6viMIo/7TRAuyoTJEyzg6a0M5LQqKihTh128PHdLZy0 gjFfOE5fcFX5+/8n8fTaIRfRroTKRXWAHbXjD5fkgqat+Q8oopoYkOyAFrf/cIfuthb335fG/b cls= X-SBRS: 2.7 X-MesageID: 7054394 X-Ironport-Server: esa1.hc3370-68.iphmx.com X-Remote-IP: 162.221.158.21 X-Policy: $RELAYED X-IronPort-AV: E=Sophos;i="5.67,304,1566878400"; d="scan'208";a="7054394" Date: Wed, 16 Oct 2019 18:04:25 +0200 From: Roger Pau =?iso-8859-1?Q?Monn=E9?= To: Stefan Parvu CC: Konstantin Belousov , Subject: Re: cannot install FreeBSD 12.0 Xen 4.12.1 on Intel Core i7 CPU 930 Message-ID: <20191016160411.GK14005@Air-de-Roger> References: <20191016090022.GE14005@Air-de-Roger> <9D9848D6-2634-4777-9EE0-8DECAD2FE5CD@kronometrix.org> <20191016091230.GF14005@Air-de-Roger> <20191016092823.GG14005@Air-de-Roger> <20191016110755.GF73312@kib.kiev.ua> <20191016113047.GI14005@Air-de-Roger> <20191016152736.GJ14005@Air-de-Roger> <9E59905F-984D-4F00-9B9B-ADAF48E7A565@kronometrix.org> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Disposition: inline In-Reply-To: <9E59905F-984D-4F00-9B9B-ADAF48E7A565@kronometrix.org> User-Agent: Mutt/1.12.2 (2019-09-21) X-ClientProxiedBy: AMSPEX02CAS02.citrite.net (10.69.22.113) To AMSPEX02CL02.citrite.net (10.69.22.126) X-Rspamd-Queue-Id: 46tcYs2bL4z3xtH X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=citrix.com header.s=securemail header.b=CQglgjUv; dmarc=pass (policy=none) header.from=citrix.com; spf=pass (mx1.freebsd.org: domain of roger.pau@citrix.com designates 216.71.145.142 as permitted sender) smtp.mailfrom=roger.pau@citrix.com X-Spamd-Result: default: False [-5.63 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[citrix.com:s=securemail]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+mx]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; IP_SCORE(-1.43)[ip: (-3.90), ipnet: 216.71.145.0/24(-1.76), asn: 16417(-1.43), country: US(-0.05)]; RCVD_DKIM_ARC_DNSWL_MED(-0.50)[]; TO_DN_SOME(0.00)[]; DWL_DNSWL_LOW(-1.00)[citrix.com.dwl.dnswl.org : 127.0.9.1]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[citrix.com:+]; RCVD_IN_DNSWL_MED(-0.20)[142.145.71.216.list.dnswl.org : 127.0.3.2]; DMARC_POLICY_ALLOW(-0.50)[citrix.com,none]; RCVD_COUNT_ZERO(0.00)[0]; FROM_EQ_ENVFROM(0.00)[]; MID_RHS_NOT_FQDN(0.50)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:16417, ipnet:216.71.145.0/24, country:US]; FREEMAIL_CC(0.00)[gmail.com] X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Oct 2019 16:04:34 -0000 On Wed, Oct 16, 2019 at 06:59:46PM +0300, Stefan Parvu wrote: > > Also, IIRC X58 had some interrupt remapping issues, can you try to > > boot with iommu=no-intremap? (without any other iommu options) > > Let me try quickly that. No serial it is too complicated for this machine. > > If we can make this running do you think FreeBSD Xen Dom0 will ever support HVM > linux guests ? FreeBSD Xen dom0 already supports Linux HVM guests, just as it supports Windows HVM guests or any kind of HVM guest in general (ie: whatever guests you can run on a Linux dom0 should also work on a FreeBSD dom0). Roger. From owner-freebsd-xen@freebsd.org Wed Oct 16 16:10:54 2019 Return-Path: Delivered-To: freebsd-xen@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 684EE149733 for ; Wed, 16 Oct 2019 16:10:54 +0000 (UTC) (envelope-from sparvu@kronometrix.org) Received: from mail.kronometrix.org (mail.kronometrix.org [95.85.46.90]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mail.kronometrix.org", Issuer "mail.kronometrix.org" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 46tcj94g8Yz3y1q for ; Wed, 16 Oct 2019 16:10:53 +0000 (UTC) (envelope-from sparvu@kronometrix.org) Received: from [192.168.1.4] (mail.kronometrix.com [79.134.105.181]) (authenticated bits=0) by mail.kronometrix.org (8.15.2/8.15.2) with ESMTPSA id x9GGAn5S089720 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Wed, 16 Oct 2019 16:10:50 GMT (envelope-from sparvu@kronometrix.org) X-Authentication-Warning: mail.kronometrix.org: Host mail.kronometrix.com [79.134.105.181] claimed to be [192.168.1.4] From: Stefan Parvu Message-Id: <22CA1E93-B0C7-496F-9ECD-70E2C6857990@kronometrix.org> Mime-Version: 1.0 (Mac OS X Mail 12.4 \(3445.104.11\)) Subject: Re: cannot install FreeBSD 12.0 Xen 4.12.1 on Intel Core i7 CPU 930 Date: Wed, 16 Oct 2019 19:10:44 +0300 In-Reply-To: <9E59905F-984D-4F00-9B9B-ADAF48E7A565@kronometrix.org> Cc: freebsd-xen@freebsd.org To: =?utf-8?Q?Roger_Pau_Monn=C3=A9?= References: <20191016084050.GD14005@Air-de-Roger> <4D6CBDA5-711B-4501-AFC1-A41D1134EF73@kronometrix.org> <20191016090022.GE14005@Air-de-Roger> <9D9848D6-2634-4777-9EE0-8DECAD2FE5CD@kronometrix.org> <20191016091230.GF14005@Air-de-Roger> <20191016092823.GG14005@Air-de-Roger> <20191016110755.GF73312@kib.kiev.ua> <20191016113047.GI14005@Air-de-Roger> <20191016152736.GJ14005@Air-de-Roger> <9E59905F-984D-4F00-9B9B-ADAF48E7A565@kronometrix.org> X-Mailer: Apple Mail (2.3445.104.11) X-Rspamd-Queue-Id: 46tcj94g8Yz3y1q X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of sparvu@kronometrix.org designates 95.85.46.90 as permitted sender) smtp.mailfrom=sparvu@kronometrix.org X-Spamd-Result: default: False [0.53 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; MV_CASE(0.50)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; HAS_XAW(0.00)[]; DMARC_NA(0.00)[kronometrix.org]; NEURAL_SPAM_MEDIUM(0.30)[0.304,0]; NEURAL_HAM_LONG(-0.59)[-0.586,0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; IP_SCORE(0.61)[ip: (0.41), ipnet: 95.85.0.0/18(0.96), asn: 14061(1.72), country: US(-0.05)]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:14061, ipnet:95.85.0.0/18, country:US]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Oct 2019 16:10:54 -0000 >=20 >> Also, IIRC X58 had some interrupt remapping issues, can you try to >> boot with iommu=3Dno-intremap? (without any other iommu options) >=20 here my /boot/loader.conf root@earth:~ # cat /boot/loader.conf=20 kern.geom.label.disk_ident.enable=3D"0" kern.geom.label.gptid.enable=3D"0" zfs_load=3D"YES" if_tap_load=3D"YES" xen_kernel=3D"/boot/xen" xen_cmdline=3D"dom0_mem=3D8192M dom0_max_vcpus=3D4 dom0=3Dpvh = console=3Dcom1,vga com1=3D115200,8n1 guest_loglvl=3Dall loglvl=3Dall = iommu=3Dno-intremap" Nope, same problem=20 and this is what I get now: http://www.kronometrix.org/bugs/freebsd_xen2.jpg = Stefan= From owner-freebsd-xen@freebsd.org Wed Oct 16 16:29:09 2019 Return-Path: Delivered-To: freebsd-xen@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id EBC53149DDC for ; Wed, 16 Oct 2019 16:29:09 +0000 (UTC) (envelope-from roger.pau@citrix.com) Received: from esa4.hc3370-68.iphmx.com (esa4.hc3370-68.iphmx.com [216.71.155.144]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "esa4.hc3370-68.iphmx.com", Issuer "HydrantID SSL ICA G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 46td6D6snQz4048 for ; Wed, 16 Oct 2019 16:29:08 +0000 (UTC) (envelope-from roger.pau@citrix.com) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=citrix.com; s=securemail; t=1571243348; h=date:from:to:cc:subject:message-id:references: mime-version:in-reply-to; bh=u3R8qufvVr5RYjlQZhS4Q5O9TW64DlOe63A2PceP7O0=; b=XhP4+Ur/1DGGfWTc6Qt61/KVrmUdumKO2QJfhNHCn5B4CMltnO4q1Odl +pGCw9FYUqLMzq0QTJs1FrtcM7z4irHh5owavkF2/ojgRotvYBqR02adj PT/PHOc1tVlKSDrAkHArCHUsm2si1NR+msla8SWR9nG9TDwJDsWG/gZLE U=; Received-SPF: None (esa4.hc3370-68.iphmx.com: no sender authenticity information available from domain of roger.pau@citrix.com) identity=pra; client-ip=162.221.158.21; receiver=esa4.hc3370-68.iphmx.com; envelope-from="roger.pau@citrix.com"; x-sender="roger.pau@citrix.com"; x-conformance=sidf_compatible Received-SPF: Pass (esa4.hc3370-68.iphmx.com: domain of roger.pau@citrix.com designates 162.221.158.21 as permitted sender) identity=mailfrom; client-ip=162.221.158.21; receiver=esa4.hc3370-68.iphmx.com; envelope-from="roger.pau@citrix.com"; x-sender="roger.pau@citrix.com"; x-conformance=sidf_compatible; x-record-type="v=spf1"; x-record-text="v=spf1 ip4:209.167.231.154 ip4:178.63.86.133 ip4:195.66.111.40/30 ip4:85.115.9.32/28 ip4:199.102.83.4 ip4:192.28.146.160 ip4:192.28.146.107 ip4:216.52.6.88 ip4:216.52.6.188 ip4:162.221.158.21 ip4:162.221.156.83 ip4:168.245.78.127 ~all" Received-SPF: None (esa4.hc3370-68.iphmx.com: no sender authenticity information available from domain of postmaster@mail.citrix.com) identity=helo; client-ip=162.221.158.21; receiver=esa4.hc3370-68.iphmx.com; envelope-from="roger.pau@citrix.com"; x-sender="postmaster@mail.citrix.com"; x-conformance=sidf_compatible IronPort-SDR: kvbe/hhLkvVI2NF5FEFA8JdnOta+t/lDPdjEVA77iP0xnXSPhFRzGzDRYjvTPJfZwFiDBgcxbI 1cXM0pc+rdolqPruHuSdI1bv/VT1ChyUsAWD8wMxljtqwETuMMDuUwHNF3DBTm0e3ltuIT3oPn sRtigqn4Dov907D6qmwugtrKUHFNndZ2Rs9qsMuF6RgdA7bOYgnSB11l+QsRI8+bkHhAEFuUgv pLT3EkphAf/o17ZpjXGswQp5Bb7Ue7B2JruJpoWKi2RLDGbcfV9htYwnQFE/DfhjDc6yAWj8ft svE= X-SBRS: 2.7 X-MesageID: 7383927 X-Ironport-Server: esa4.hc3370-68.iphmx.com X-Remote-IP: 162.221.158.21 X-Policy: $RELAYED X-IronPort-AV: E=Sophos;i="5.67,304,1566878400"; d="scan'208";a="7383927" Date: Wed, 16 Oct 2019 18:28:59 +0200 From: Roger Pau =?iso-8859-1?Q?Monn=E9?= To: Stefan Parvu CC: Subject: Re: cannot install FreeBSD 12.0 Xen 4.12.1 on Intel Core i7 CPU 930 Message-ID: <20191016162339.GL14005@Air-de-Roger> References: <9D9848D6-2634-4777-9EE0-8DECAD2FE5CD@kronometrix.org> <20191016091230.GF14005@Air-de-Roger> <20191016092823.GG14005@Air-de-Roger> <20191016110755.GF73312@kib.kiev.ua> <20191016113047.GI14005@Air-de-Roger> <20191016152736.GJ14005@Air-de-Roger> <9E59905F-984D-4F00-9B9B-ADAF48E7A565@kronometrix.org> <22CA1E93-B0C7-496F-9ECD-70E2C6857990@kronometrix.org> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Disposition: inline In-Reply-To: <22CA1E93-B0C7-496F-9ECD-70E2C6857990@kronometrix.org> User-Agent: Mutt/1.12.2 (2019-09-21) X-ClientProxiedBy: AMSPEX02CAS01.citrite.net (10.69.22.112) To AMSPEX02CL02.citrite.net (10.69.22.126) X-Rspamd-Queue-Id: 46td6D6snQz4048 X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=citrix.com header.s=securemail header.b=XhP4+Ur/; dmarc=pass (policy=none) header.from=citrix.com; spf=pass (mx1.freebsd.org: domain of roger.pau@citrix.com designates 216.71.155.144 as permitted sender) smtp.mailfrom=roger.pau@citrix.com X-Spamd-Result: default: False [-6.20 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[citrix.com:s=securemail]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; RCVD_DKIM_ARC_DNSWL_MED(-0.50)[]; DWL_DNSWL_LOW(-1.00)[citrix.com.dwl.dnswl.org : 127.0.9.1]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_MED(-0.20)[144.155.71.216.list.dnswl.org : 127.0.3.2]; DKIM_TRACE(0.00)[citrix.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[citrix.com,none]; RCVD_COUNT_ZERO(0.00)[0]; FROM_EQ_ENVFROM(0.00)[]; MID_RHS_NOT_FQDN(0.50)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:16417, ipnet:216.71.154.0/23, country:US]; IP_SCORE(-2.00)[ip: (-5.62), ipnet: 216.71.154.0/23(-2.84), asn: 16417(-1.47), country: US(-0.05)] X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Oct 2019 16:29:10 -0000 On Wed, Oct 16, 2019 at 07:10:44PM +0300, Stefan Parvu wrote: > > > >> Also, IIRC X58 had some interrupt remapping issues, can you try to > >> boot with iommu=no-intremap? (without any other iommu options) > > > > here my /boot/loader.conf > > root@earth:~ # cat /boot/loader.conf > kern.geom.label.disk_ident.enable="0" > kern.geom.label.gptid.enable="0" > zfs_load="YES" > if_tap_load="YES" > xen_kernel="/boot/xen" > xen_cmdline="dom0_mem=8192M dom0_max_vcpus=4 dom0=pvh console=com1,vga com1=115200,8n1 guest_loglvl=all loglvl=all iommu=no-intremap" > > > Nope, same problem > > and this is what I get now: > http://www.kronometrix.org/bugs/freebsd_xen2.jpg Hm, can you remove iommu=no-intremap and try to capture a video of Xen booting? I'm hoping I might be able to spot why Xen is refusing to use the iommu. Roger. From owner-freebsd-xen@freebsd.org Wed Oct 16 17:37:29 2019 Return-Path: Delivered-To: freebsd-xen@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id CF18014C1E3 for ; Wed, 16 Oct 2019 17:37:29 +0000 (UTC) (envelope-from sparvu@kronometrix.org) Received: from mail.kronometrix.org (mail.kronometrix.org [95.85.46.90]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mail.kronometrix.org", Issuer "mail.kronometrix.org" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 46tfd43wFSz44Rf for ; Wed, 16 Oct 2019 17:37:28 +0000 (UTC) (envelope-from sparvu@kronometrix.org) Received: from [10.192.88.83] (37-219-160-123.nat.bb.dnainternet.fi [37.219.160.123]) (authenticated bits=0) by mail.kronometrix.org (8.15.2/8.15.2) with ESMTPSA id x9GHbKvo090319 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NO); Wed, 16 Oct 2019 17:37:21 GMT (envelope-from sparvu@kronometrix.org) X-Authentication-Warning: mail.kronometrix.org: Host 37-219-160-123.nat.bb.dnainternet.fi [37.219.160.123] claimed to be [10.192.88.83] Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable From: Stefan Parvu Mime-Version: 1.0 (1.0) Subject: Re: cannot install FreeBSD 12.0 Xen 4.12.1 on Intel Core i7 CPU 930 Date: Wed, 16 Oct 2019 20:37:15 +0300 Message-Id: <5E670B06-94C5-4B19-87EE-194B00F3C775@kronometrix.org> References: <20191016162339.GL14005@Air-de-Roger> Cc: freebsd-xen@freebsd.org In-Reply-To: <20191016162339.GL14005@Air-de-Roger> To: =?utf-8?Q?Roger_Pau_Monn=C3=A9?= X-Mailer: iPhone Mail (17A878) X-Rspamd-Queue-Id: 46tfd43wFSz44Rf X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of sparvu@kronometrix.org designates 95.85.46.90 as permitted sender) smtp.mailfrom=sparvu@kronometrix.org X-Spamd-Result: default: False [0.53 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; MV_CASE(0.50)[]; MIME_GOOD(-0.10)[text/plain]; HAS_XAW(0.00)[]; DMARC_NA(0.00)[kronometrix.org]; NEURAL_SPAM_MEDIUM(0.36)[0.360,0]; NEURAL_HAM_LONG(-0.64)[-0.641,0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; IP_SCORE(0.61)[ip: (0.41), ipnet: 95.85.0.0/18(0.95), asn: 14061(1.72), country: US(-0.05)]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:14061, ipnet:95.85.0.0/18, country:US]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Oct 2019 17:37:29 -0000 Thank you for help and tips. I need to find another server, newer and try Xe= n or bhyve.=20 Most likely we will decommission this box or install debian 9 or 10/kvm for i= t. Lets see. Stefan > On 16. Oct 2019, at 19.29, Roger Pau Monn=C3=A9 wro= te: >=20 > =EF=BB=BFOn Wed, Oct 16, 2019 at 07:10:44PM +0300, Stefan Parvu wrote: >>>=20 >>>> Also, IIRC X58 had some interrupt remapping issues, can you try to >>>> boot with iommu=3Dno-intremap? (without any other iommu options) >>>=20 >>=20 >> here my /boot/loader.conf >>=20 >> root@earth:~ # cat /boot/loader.conf=20 >> kern.geom.label.disk_ident.enable=3D"0" >> kern.geom.label.gptid.enable=3D"0" >> zfs_load=3D"YES" >> if_tap_load=3D"YES" >> xen_kernel=3D"/boot/xen" >> xen_cmdline=3D"dom0_mem=3D8192M dom0_max_vcpus=3D4 dom0=3Dpvh console=3Dc= om1,vga com1=3D115200,8n1 guest_loglvl=3Dall loglvl=3Dall iommu=3Dno-intrema= p" >>=20 >>=20 >> Nope, same problem=20 >>=20 >> and this is what I get now: >> http://www.kronometrix.org/bugs/freebsd_xen2.jpg >=20 > Hm, can you remove iommu=3Dno-intremap and try to capture a video of Xen > booting? I'm hoping I might be able to spot why Xen is refusing to use > the iommu. >=20 > Roger. From owner-freebsd-xen@freebsd.org Fri Oct 18 20:22:56 2019 Return-Path: Delivered-To: freebsd-xen@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 15164159D80 for ; Fri, 18 Oct 2019 20:22:56 +0000 (UTC) (envelope-from deidra.monika@leadlicensing.tech) Received: from IND01-MA1-obe.outbound.protection.outlook.com (mail-eopbgr1380115.outbound.protection.outlook.com [40.107.138.115]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "GlobalSign Organization Validation CA - SHA256 - G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 46vyC24R9Rz3yvK for ; Fri, 18 Oct 2019 20:22:54 +0000 (UTC) (envelope-from deidra.monika@leadlicensing.tech) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=hm13U9E9XGMUhCKaxm+CK9K5tgc1WYVqXCKI3Z+XxSuwZnlmw0Yr83/1VS9wrXzq/x5lFtlaqZT1m32TLO5XUqRU/QLWNaEvpYMYaLHbLLCo9kVJweEqyg2gFVb5z/s3oDmWlySCNzCF+IKhITx+TZmDu+AH29H/1KqanjZLS+ImSX1LSB74sPIvuBaID3lC1kEp/oknlmvi1Xt0S3U+1JMqEyu4dUA0Jtv5DHwXTxy3uMhHQe3dVh1dfu9ewAmFsxrbWbMTwdJ2Sp70B+CBXHlIOEbf80sxj84v9mhvOgXflZZ9leqdLKILhepF98TB/8fBK64Yud1lDaBCY3KjaQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=UI6MgxaFqQG07TFfSPXxviR7SaXPbfIwdqvMSA8Vx3o=; b=Xa2wTyAyZraZ9KB4PMcsuzF0iKZpqU9ZFPSIe0fJ8hVWCjecuR/c0r+xa0UBmSteJhcdBStr1LY/ycSL7kvfmWhNpS1KTYb1v5vcKnxKqjtgHrvRZLTZqpxlTwSmRp7JO9/8+mQoaGdwVwBEZA4q4O55g5joD0ranchYoDURe5kyoeHHaZs7Gxfbt1gFPDJWEw9ToUmIq4eEqDO3LMvQDesCO5gKIxRetMjddYAso0D9ekRrcT/+psH2P0w29t5ta4dwF7lQBC+hjP0h4Z24ZDyOfJzaAsRJKHYBp2y7eVwFVqzoj0NK6ocxFm9x8LvUeuoBZ8uG0vuiIq9IWGhp0Q== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=leadlicensing.tech; dmarc=pass action=none header.from=leadlicensing.tech; dkim=pass header.d=leadlicensing.tech; arc=none Received: from BM1PR01MB3619.INDPRD01.PROD.OUTLOOK.COM (52.133.237.202) by BM1PR01MB2675.INDPRD01.PROD.OUTLOOK.COM (20.178.175.85) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2347.21; Fri, 18 Oct 2019 20:22:51 +0000 Received: from BM1PR01MB3619.INDPRD01.PROD.OUTLOOK.COM ([fe80::f57c:9ae8:d3d6:6acf]) by BM1PR01MB3619.INDPRD01.PROD.OUTLOOK.COM ([fe80::f57c:9ae8:d3d6:6acf%5]) with mapi id 15.20.2347.028; Fri, 18 Oct 2019 20:22:51 +0000 From: Deidra Monika To: "freebsd-xen@freebsd.org" Subject: Go To Market strategy 2019 Thread-Topic: Go To Market strategy 2019 Thread-Index: AdWF8c78Dekbw5PgRHen8zANGuF1NA== Date: Fri, 18 Oct 2019 20:22:51 +0000 Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [183.82.16.122] x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 3f9282dc-9f3f-45a4-d150-08d75408f334 x-ms-traffictypediagnostic: BM1PR01MB2675: x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:1148; x-forefront-prvs: 01949FE337 x-forefront-antispam-report: SFV:NSPM; SFS:(10019020)(34096005)(346002)(396003)(39510400003)(39840400004)(136003)(376002)(366004)(448600002)(189003)(199004)(33656002)(86362001)(790700001)(102836004)(76116006)(5660300002)(186003)(66946007)(66476007)(64756008)(66446008)(9686003)(66556008)(8936002)(44832011)(71200400001)(9326002)(81166006)(8676002)(71190400001)(6916009)(25786009)(586005)(38610400001)(81156014)(2906002)(256004)(55016002)(99286004)(2351001)(7736002)(14444005)(7696005)(486006)(2501003)(74316002)(6306002)(54896002)(476003)(6506007)(14454004)(66066001)(26005)(6116002)(3846002)(6436002)(4744005)(5640700003)(52536014)(102460200003); DIR:OUT; SFP:1102; SCL:1; SRVR:BM1PR01MB2675; H:BM1PR01MB3619.INDPRD01.PROD.OUTLOOK.COM; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; MX:1; A:1; received-spf: None (protection.outlook.com: leadlicensing.tech does not designate permitted sender hosts) x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: ME1YwevD9Cby89cP5RBy0990uDcENRE/TPFCjIg2AFyKO8tZ5N6zBIS3DiD36cmzzfNpXDCfgtqbYIQq2a7MoS5RGcBm5dSFl2RxUou1EQq4vwc6TNoCg8k+pxJ3m0LAZDAO+uBFish5heriLg/Z5ELzHYGT4p+qLvt/ck52GRClpQbP/g51MmWLTeKkBvGx6w+esvzO9T2dLpH96u+bXgtIzKwUaPzMx6o4IRgCn9pcX71hkYDcDt0O7IV3+BVilm/O70p7JgVspZ5cSGT704W8npXpqD/57haZp9vXuxtFoucpNBImN+KF9y10yrn20aSNsM2EzyIToJeBYZYzkb+0HoYtU9SZqWVwmgYCArLm18U29IyGUeLQc2uctqhfuQW1xMMxn5pdIlkwn7PVd3cj/bnut15EeE1y4R/5rL4= x-ms-exchange-transport-forked: True MIME-Version: 1.0 X-OriginatorOrg: leadlicensing.tech X-MS-Exchange-CrossTenant-Network-Message-Id: 3f9282dc-9f3f-45a4-d150-08d75408f334 X-MS-Exchange-CrossTenant-originalarrivaltime: 18 Oct 2019 20:22:51.1891 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: d57d8fdf-0863-49ee-830f-60aa626a828e X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: BFrbT2I9QU3WZiv/kgJo/A94LxM3LSp+ayblLeNPWhSn1gAyIBD7YeSZt2Q7OSQn5bKfdR3uWnmRjuxpPVyCnC2oKc7MN2nO6tRKyY//y99CW2JVzAgepkIhnK2A/TCK X-MS-Exchange-Transport-CrossTenantHeadersStamped: BM1PR01MB2675 X-Rspamd-Queue-Id: 46vyC24R9Rz3yvK X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=softfail (mx1.freebsd.org: 40.107.138.115 is neither permitted nor denied by domain of deidra.monika@leadlicensing.tech) smtp.mailfrom=deidra.monika@leadlicensing.tech X-Spamd-Result: default: False [-4.43 / 15.00]; RCVD_TLS_LAST(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; HAS_XOIP(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; DMARC_NA(0.00)[leadlicensing.tech]; R_SPF_SOFTFAIL(0.00)[~all:c]; RCPT_COUNT_ONE(0.00)[1]; RCVD_COUNT_THREE(0.00)[3]; IP_SCORE(-1.33)[ipnet: 40.64.0.0/10(-3.92), asn: 8075(-2.68), country: US(-0.05)]; RCVD_IN_DNSWL_NONE(0.00)[115.138.107.40.list.dnswl.org : 127.0.3.0]; TO_DN_EQ_ADDR_ALL(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; R_DKIM_NA(0.00)[]; ASN(0.00)[asn:8075, ipnet:40.64.0.0/10, country:US]; ARC_ALLOW(-1.00)[i=1] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 18 Oct 2019 20:22:56 -0000 Hi, I'm writing to find out if you would like to acquire below users list with = the install base for your Go-to-market Strategy 2019. Technology Install base Data Integration 37,000 Companies Data Storage Hardware 74,083 Companies Big Data 91,128 Companies Backup Software 152,391 Companies IT Management Software 176,739 Companies Virtualization Platforms 177,159 Companies ERP 189,516 Companies CRM 193,657 Companies Business Intelligence 220,703 Companies DBMS 589,593 Companies We can also provide:- * Other Technology user's lists. * Geo-Targeted lists. * Industry-wise Decision Makers lists. * Job Titles lists (C/V/D/M - IT, HR, Finance, Accounting, Tax etc.= ). * B2B Professionals Lists (CEO, CAO, CTO, CIO, CISO, CFO, COO, CBO,= CHRO etc.). Kindly specify your target criteria and I'll get back to you with further i= nformation. Awaiting your response! Regards, Deidra Monika Marketing Manager If you like to exclude yourself from this email communication, reply with W= ipe Out.