From owner-freebsd-virtualization@freebsd.org Wed Apr 5 04:40:57 2017 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 45427D2FE02 for ; Wed, 5 Apr 2017 04:40:57 +0000 (UTC) (envelope-from jtubnor@gmail.com) Received: from mail-vk0-x233.google.com (mail-vk0-x233.google.com [IPv6:2607:f8b0:400c:c05::233]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id F32746D5 for ; Wed, 5 Apr 2017 04:40:56 +0000 (UTC) (envelope-from jtubnor@gmail.com) Received: by mail-vk0-x233.google.com with SMTP id d188so1096394vka.0 for ; Tue, 04 Apr 2017 21:40:56 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:sender:from:date:message-id:subject:to; bh=ZIyJ+cju0Y4PAjKLv7H8/GZh3tGBonY7W3zTpWAgiG0=; b=qHLJclPHUZwUfDVg8Qklq5AHt0O4SOTOl4dYPOP3a5yZGmyT8rtcTq0DoA30EhQ+wv 1soSXGZMSI0L4TZxHCck4uXGs0xNgjLbqbKbuC7Mv/Hss1v++LXPmpmu0GWS4CC5VIua BiiD0aOqqsDwwETbUmBzT2G7VLsyeEl0XhwwSE5g2y7iDuOUnuyQa8sQBA5RHEpzANnV n8uzxItNFHNSLftIvctPqwL/wcCjmUtajLgKQGM3vZs2amtiu+PV++jMtsQn60BHs9Kd QIHur+mIioypElsHVoDNFyA64dG0fWw8JzAywZNii7iDscvaSZdM2f8Sa03FhLWIpGbd jdxg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:sender:from:date:message-id:subject :to; bh=ZIyJ+cju0Y4PAjKLv7H8/GZh3tGBonY7W3zTpWAgiG0=; b=XVYh7WvM69iY4gEtV9w+YqJxZvf3HrrPVS4HFxbuOMRaBGayDBHECQD0YXEYhEHlBv poeqDM6JJR9+N27rt8Dg77/DNpc9sI8vwavyRvhksA7AMz1jcLJGl23tJy6KnE+lWrDK OsTfCYFMSHbsHyPbB1kpBbFdGL/6lhQBp3qI7rK2nOerjFHW5MvaLJ+sQ/qPEa716kWY r9uvabs5cDDlR/WqEvQ3Eowijbn+8Bysaecrj6uTLtBtNXXYz1xsDKG30EuKj99+FbR8 XmO2lTEjWxM5weh3TH/tNQO2WUf8IRFedRST2ZV7len8kkrZVww7h8K+yjKiNd0f/dIi e1vg== X-Gm-Message-State: AFeK/H3yWQottGNq9bm+S1r89u328sbKU2Zep+gpZn2F+yp7FfxsHbOmJwyOx4wqEuzrIRi1EI3F+x6H846YFA== X-Received: by 10.31.205.67 with SMTP id d64mr12347425vkg.166.1491367255432; Tue, 04 Apr 2017 21:40:55 -0700 (PDT) MIME-Version: 1.0 Sender: jtubnor@gmail.com Received: by 10.176.69.145 with HTTP; Tue, 4 Apr 2017 21:40:35 -0700 (PDT) From: Jason Tubnor Date: Wed, 5 Apr 2017 14:40:35 +1000 X-Google-Sender-Auth: Fw_m5ieBmpaDvPuOvG1qPbXX1Zs Message-ID: Subject: OpenBSD 6.1-snapshot no longer works in bhyve To: "freebsd-virtualization@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 05 Apr 2017 04:40:57 -0000 I thought I would raise the above on the misc@openbsd.org mail list as I was concluding my testing for the upcoming 6.1 release. Here is my initial email: http://marc.info/?l=openbsd-misc&m=149136052120277&w=2 Based on the responses: http://marc.info/?l=openbsd-misc&m=149136160420488&w=2 and http://marc.info/?l=openbsd-misc&m=149136173520510&w=2 it appears that bhyve is publishing a CPU feature that actually isn't there. FYI, 6.1-release and 6.1-snapshots will not boot at this stage. I have my new production kit arriving so I can test on different hardware to determine if this is a CPU rev. issue but thought I'd put it here to get the thought processes working on it. I am running 11.0-release p8 Thanks, Jason. dmesg ----------------- Copyright (c) 1992-2016 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 11.0-RELEASE-p8 #0: Wed Feb 22 06:12:04 UTC 2017 root@amd64-builder.daemonology.net:/usr/obj/usr/src/sys/GENERIC amd64 FreeBSD clang version 3.8.0 (tags/RELEASE_380/final 262564) (based on LLVM 3.8.0) VT(efifb): resolution 1440x900 CPU: Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz (3491.99-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory = 8589934592 (8192 MB) avail memory = 8160088064 (7782 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs FreeBSD/SMP: 1 package(s) x 4 core(s) x 2 hardware threads random: unblocking device. ioapic0 irqs 0-23 on motherboard ioapic1 irqs 24-47 on motherboard random: entropy device external interface kbd1 at kbdmux0 netmap: loaded module module_register_init: MOD_LOAD (vesa, 0xffffffff8101d970, 0) error 19 random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" cryptosoft0: on motherboard acpi0: on motherboard acpi0: Power Button (fixed) cpu0: numa-domain 0 on acpi0 cpu1: numa-domain 0 on acpi0 cpu2: numa-domain 0 on acpi0 cpu3: numa-domain 0 on acpi0 cpu4: numa-domain 0 on acpi0 cpu5: numa-domain 0 on acpi0 cpu6: numa-domain 0 on acpi0 cpu7: numa-domain 0 on acpi0 atrtc0: port 0x70-0x71,0x74-0x77 irq 8 on acpi0 Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 550 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: on acpi0 pci0: on pcib0 acpi_button0: on acpi0 pcib1: port 0xcf8-0xcff on acpi0 pcib1: _OSC returned error 0x10 pci1: on pcib1 pcib2: irq 47 at device 1.0 on pci1 pci2: on pcib2 pcib3: at device 0.0 on pci2 pci3: on pcib3 pcib4: at device 2.0 on pci3 pci4: on pcib4 bce0: mem 0xf6000000-0xf7ffffff at device 0.0 on pci4 miibus0: on bce0 brgphy0: PHY 1 on miibus0 brgphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow bce0: Using defaults for TSO: 65518/35/2048 bce0: Ethernet address: 00:10:18:bf:c4:e8 bce0: ASIC (0x57092003); Rev (C0); Bus (PCIe x4, 5Gbps); B/C (5.2.2); Bufs (RX:2;TX:2;PG:8); Flags (SPLT|MSI) Coal (RX:6,6,18,18; TX:20,20,80,80) bce1: mem 0xf8000000-0xf9ffffff at device 0.1 on pci4 miibus1: on bce1 brgphy1: PHY 1 on miibus1 brgphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow bce1: Using defaults for TSO: 65518/35/2048 bce1: Ethernet address: 00:10:18:bf:c4:ea bce1: ASIC (0x57092003); Rev (C0); Bus (PCIe x4, 5Gbps); B/C (5.2.2); Bufs (RX:2;TX:2;PG:8); Flags (SPLT|MSI) Coal (RX:6,6,18,18; TX:20,20,80,80) pcib5: at device 4.0 on pci3 pci5: on pcib5 bce2: mem 0xf2000000-0xf3ffffff at device 0.0 on pci5 miibus2: on bce2 brgphy2: PHY 1 on miibus2 brgphy2: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow bce2: Using defaults for TSO: 65518/35/2048 bce2: Ethernet address: 00:10:18:bf:c4:ec bce2: ASIC (0x57092003); Rev (C0); Bus (PCIe x4, 5Gbps); B/C (5.2.2); Bufs (RX:2;TX:2;PG:8); Flags (SPLT|MSI) Coal (RX:6,6,18,18; TX:20,20,80,80) bce3: mem 0xf4000000-0xf5ffffff at device 0.1 on pci5 miibus3: on bce3 brgphy3: PHY 1 on miibus3 brgphy3: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow bce3: Using defaults for TSO: 65518/35/2048 bce3: Ethernet address: 00:10:18:bf:c4:ee bce3: ASIC (0x57092003); Rev (C0); Bus (PCIe x4, 5Gbps); B/C (5.2.2); Bufs (RX:2;TX:2;PG:8); Flags (SPLT|MSI) Coal (RX:6,6,18,18; TX:20,20,80,80) pcib6: irq 47 at device 2.0 on pci1 pci6: on pcib6 vgapci0: port 0x1000-0x107f mem 0xfa000000-0xfaffffff,0xe0000000-0xefffffff,0xf0000000-0xf1ffffff irq 32 at device 0.0 on pci6 vgapci0: Boot video device hdac0: mem 0xfb000000-0xfb003fff irq 36 at device 0.1 on pci6 pcib7: irq 47 at device 3.0 on pci1 pci7: on pcib7 pci1: at device 17.0 (no driver attached) ahci0: port 0x20a0-0x20a7,0x20b4-0x20b7,0x2098-0x209f,0x20b0-0x20b3,0x2040-0x205f mem 0xfb13c000-0xfb13c7ff irq 16 at device 17.4 on pci1 ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahciem0: on ahci0 xhci0: mem 0xfb120000-0xfb12ffff irq 19 at device 20.0 on pci1 xhci0: 32 bytes context size, 64-bit DMA usbus0 on xhci0 pci1: at device 22.0 (no driver attached) pci1: at device 22.3 (no driver attached) em0: port 0x2020-0x203f mem 0xfb100000-0xfb11ffff,0xfb13a000-0xfb13afff irq 20 at device 25.0 on pci1 em0: Using an MSI interrupt em0: Ethernet address: 64:51:06:4a:4b:df em0: netmap queues/slots: TX 1/1024, RX 1/1024 ehci0: mem 0xfb139000-0xfb1393ff irq 18 at device 26.0 on pci1 usbus1: EHCI version 1.0 usbus1 on ehci0 hdac1: mem 0xfb130000-0xfb133fff irq 22 at device 27.0 on pci1 pcib8: irq 16 at device 28.0 on pci1 pci8: on pcib8 pcib9: irq 17 at device 28.1 on pci1 pci9: on pcib9 pcib10: at device 28.3 on pci1 pci10: on pcib10 pcib11: at device 0.0 on pci10 pci11: on pcib11 pcib12: irq 16 at device 28.4 on pci1 pci12: on pcib12 ehci1: mem 0xfb138000-0xfb1383ff irq 18 at device 29.0 on pci1 usbus2: EHCI version 1.0 usbus2 on ehci1 isab0: at device 31.0 on pci1 isa0: on isab0 atapci0: port 0x2088-0x208f,0x20ac-0x20af,0x2080-0x2087,0x20a8-0x20ab,0x2070-0x207f,0x2060-0x206f irq 16 at device 31.2 on pci1 ata2: at channel 0 on atapci0 ata3: at channel 1 on atapci0 atkbdc0: port 0x60,0x64 irq 1 on acpi0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] orm0: at iomem 0xd7800-0xd87ff on isa0 ppc0: cannot reserve I/O port range est0: numa-domain 0 on cpu0 est1: numa-domain 0 on cpu1 est2: numa-domain 0 on cpu2 est3: numa-domain 0 on cpu3 est4: numa-domain 0 on cpu4 est5: numa-domain 0 on cpu5 est6: numa-domain 0 on cpu6 est7: numa-domain 0 on cpu7 usbus0: 5.0Gbps Super Speed USB v3.0 ZFS filesystem version: 5 ZFS storage pool version: features support (5000) Timecounters tick every 1.000 msec nvme cam probe device init hdacc0: at cad 0 on hdac0 hdaa0: at nid 1 on hdacc0 pcm0: at nid 4 on hdaa0 pcm1: at nid 5 on hdaa0 hdacc1: at cad 0 on hdac1 hdaa1: at nid 1 on hdacc1 pcm2: at nid 23 and 24,26,27 on hdaa1 pcm3: at nid 20,33 on hdaa1 usbus1: 480Mbps High Speed USB v2.0 usbus2: 480Mbps High Speed USB v2.0 ugen0.1: <0x8086> at usbus0 uhub0: <0x8086 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0 ugen1.1: at usbus1 uhub1: on usbus1 ugen2.1: at usbus2 uhub2: on usbus2 uhub1: 2 ports with 2 removable, self powered uhub2: 2 ports with 2 removable, self powered uhub0: 21 ports with 21 removable, self powered ugen0.2: at usbus0 ukbd0: on usbus0 kbd2 at ukbd0 ugen1.2: at usbus1 uhub3: on usbus1 ugen2.2: at usbus2 uhub4: on usbus2 ses0 at ahciem0 bus 0 scbus4 target 0 lun 0 ses0: SEMB S-E-S 2.00 device ses0: SEMB SES Device ada0 at ahcich0 bus 0 scbus0 target 0 lun 0 ada0: ACS-2 ATA SATA 3.x device ada0: Serial Number WD-WCC3F5VFLZY6 ada0: 600.000MB/s transfers (SATA 3.x, UDMA5, PIO 8192bytes) ada0: Command Queueing enabled ada0: 953869MB (1953525168 512 byte sectors) ada1 at ahcich1 bus 0 scbus1 target 0 lun 0 ada1: ACS-2 ATA SATA 3.x device ada1: Serial Number Z4Y86N2K ada1: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes) ada1: Command Queueing enabled ada1: 953869MB (1953525168 512 byte sectors) uhub3: 6 ports with 6 removable, self powered ada1: quirks=0x1<4K> ada2 at ahcich2 bus 0 scbus2 target 0 lun 0 ada2: ACS-2 ATA SATA 3.x device ada2: Serial Number CVCV2080008A060AGN ada2: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes) ada2: Command Queueing enabled ada2: 57241MB (117231408 512 byte sectors) SMP: AP CPU #1 Launched! SMP: AP CPU #6 Launched! SMP: AP CPU #5 Launched! SMP: AP CPU #3 Launched! SMP: AP CPU #4 Launched! SMP: AP CPU #2 Launched! SMP: AP CPU #7 Launched! Timecounter "TSC-low" frequency 1745995300 Hz quality 1000 Trying to mount root from zfs:zroot/ROOT/default []... uhub4: 8 ports with 8 removable, self powered ugen0.3: at usbus0 uhub5: on usbus0 uhub5: MTT enabled GEOM_MIRROR: Device mirror/swap launched (2/2). Root mount waiting for: usbus0 uhub5: 4 ports with 4 removable, self powered Root mount waiting for: usbus0 ugen0.4: at usbus0 uhub6: on usbus0 uhub6: 4 ports with 4 removable, self powered bce0: link state changed to DOWN bce3: link state changed to DOWN bce0: Gigabit link up! bce0: link state changed to UP bce0: Gigabit link up! bce0: Gigabit link up! tap50: Ethernet address: 00:bd:72:a2:f7:32 bridge0: Ethernet address: 02:a3:84:b8:89:00 bce0: promiscuous mode enabled bridge0: link state changed to UP tap50: promiscuous mode enabled tap20: Ethernet address: 00:bd:ca:a2:f7:14 bridge2: Ethernet address: 02:a3:84:b8:89:02 bce3: promiscuous mode enabled bridge2: link state changed to DOWN tap20: promiscuous mode enabled tap50: link state changed to UP tap20: link state changed to UP bridge2: link state changed to UP bce3: Gigabit link up! bce3: link state changed to UP